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ABSTRACT 


Multiple  criteria  approaches  to  decision  situations  are  receiving 
increased  popularity  due  to  the  increasing  importance  society  places  on 
incorporating  the  non-commensurate  and  conflicting  objectives  of  a 
situation  into  the  choice  making  process. 

Process  algorithms  for  multiple  objective  optimization  theory 
(MOOT)  and  multiple  attribute  utility  theory  (MAUT)  are  presented  at  a 
theoretical  level  as  well  as  at  the  application  level  in  a  systems 
engineering  framework  appropriate  for  choice  making.  A  subsequent  com¬ 
parison  of  the  two  approaches  motivated  a  combined  MOOT/MAUT  methodology 
which  utilizes,  in  an  efficient  manner,  the  complementary  aspects  of  both 
processes. 

Results  are  presented  of  the  application  of  this  joint  approach  to 
a  defense  systems  acquisition  problem.  Specifically,  a  paradigm  for 
electronic  warfare  aircraft  retrofit  was  developed  using  the  combined 
multicriteria  MOOT/MAUT  process.  A  set  of  criteria  was  developed 
in  this  application  which  can  be  used  to  evaluate,  in  a  comprehensive 
manner,  alternative  system  configurations .  <  • 
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ABSTRACT 


Multiple  criteria  approaches  to  decision  situations  are  receiving 
increased  popularity  due  to  the  increasing  importance  society  places  on 
incorporating  the  non-commensurate  and  conflicting  objectives  of  a 
situation  into  the  choice  making  process. 

Process  algorithms  for  multiple  objective  optimization  theory 
(MOOT)  and  multiple  attribute  utility  theory  (MAUT)  are  presented  at  a 
theoretical  level  as  well  as  at  the  application  level  in  a  systems 
engineering  framework  appropriate  for  choice  making.  A  subsequent  com¬ 
parison  of  the  two  approaches  motivated  a  combined  MOOT/MAUT  methodology 
which  utilizes,  in  an  efficient  manner,  the  complementary  aspects  of  both 
processes . 

Results  are  presented  of  the  application  of  this  joint  approach  to 
a  defense  systems  acquisition  problem.  Specifically,  a  paradigm  for 
electronic  warfare  aircraft  retrofit  was  developed  using  the  combined 
multicriteria  MOOT/MAUT  process.  A  set  of  criteria  was  developed 
in  this  application  which  can  be  used  to  evaluate,  in  a  comprehensive 
manner,  alternative  system  configurations. 


iv 


ACKNOWLEDGEMENTS 


It  is  a  pleasure  for  me  to  acknowledge  and  thank  the  people  and 
agencies  who  have  aided  me  in  this  research  effort. 

I  would  like  to  express  my  sincere  appreciation  to  Professor 
Andrew  P.  Sage  for  his  patience  and  guidance  which  were  of  immeasurable 
value  in  helping  me  produce  this  dissertation. 

I  wish  to  thank  Professors  John  E.  Gibson  and  Chelsea  C.  White,  III 
for  their  advice  and  contributions  in  this  effort.  My  thanks  are  also 
extended  to  Professors  Robert  Kuhlthau  and  Preston  White  for  reviewing 
the  dissertation. 

My  appreciation  is  extended  to  the  personnel  from  the  Department 
of  Defense  and  private  concerns  who  supplied  data  and  their  time  in  the 
application  effort. 

I  owe  a  debt  of  gratitude  to  my  fellow  students  at  the  University 
of  Virginia  for  their  stimulating  discussions  which  broadened  my  back¬ 
ground. 

I  would  especially  like  to  thank  my  wife,  Jane,  and  family  whose 
patience,  sacrifice,  and  unswerving  confidence  enabled  me  to  complete 
this  effort. 


TABLE  OF  CONTENTS 


Page 


Abstract . . 

Acknowledgements .  v 

Executive  Summary  .  ix 

Abbreviations  and  Acronyms . xvii 

Glossary . xix 

List  Of  Tables . xxi 

List  Of  Figures  . . xxii 

Chapter 

1  A  Perspective  On  Multiple  Criteria  Decision  Making .  1 

1.  Introduction .  1 

2.  The  Decision  Situation .  3 

3.  Multicriteria  Decision  Making  .  3 

4.  Systems  Engineering  Methodology  .  6 

5.  Dissertation  Organization  .  7 

6.  Summary .  8 

References .  9 

2  Multiple  Criteria  Approaches  To  Decision  Situations  ....  12 

1.  Introduction . 12 

2.  MOOT  At  The  Theoretical  Level . 12 

2.1  MOOT  -  Non-Stochastic/Time  Invariant  Case . 15 

2.2  MOOT  -  Time  Invariant/Uncertain  Outcomes  Case.  .  .  17 

2.3  MOOT  -  Non-Stochastic/Time  Varying  Case . 22 

2. A  MOOT  -  Outcome  Uncertainty/Time  Varying  Case  ...  23 

3.  A  Multiple  Objective  Optimization  Process  .  23 

3.1  Description  Of  The  Deterministic/Static 

MOOT  Process . 24 

3.2  Modifications  To  The  MOOT  Process  Due  To 

Probabilistic  And  Dynamic  Considerations  ....  33 

4.  An  Example  Of  MOOT . 33 

5.  Summary  .  . . 41 

References . 42 


vi 


Page 


Chapter 

3  Multiple  Attribute  Utility  Approach  To  Decision 

Situations . A  A 

1.  Introduction . AA 

2.  Description  Of  MAUT  At  The  Theoretical  Level . AA 

2.1  MAUT  -  Certain  Outcomes/Time  Invariant  Case.  .  .  .  AA 

2.2  MAUT  -  Uncertain  Outcomes/Time  Invariant  Case.  .  .  A5 

2.3  MAUT  -  Time  Varying  Case . A6 

3.  Multiple  Attribute  Utility  Process . A9 

3 . 1  Description  Of  The  MAUT  Process  Uncertain 

Outcomes . A9 

3.2  Variation  In  The  MAUT  Process  With  Certainty 

Of  Outcomes . 56 

A.  An  Example  Of  MAUT . 56 

5.  Summary . 61 

References . 63 

A  A  Combined  MOOT/MAUT  Approach  To  Decision  Situations.  ...  65 

1.  Introduction . 65 

2.  Comparison  of  HOOT  and  MAUT  Processes . 65 

2.1  Structural  Comparison.  ....  .  65 

2.2  Function  And  Purpose  Comparison  Of  HOOT  And 

MAUT . 66 

2.3  Organizational  Implications  Of  The  Application 

Of  MOOT  And  MAUT  At  The  Practice  Level . 63 

3.  A  Combined  MOOT/MAUT  Approach . 69 

3.1  Complementary  Aspects  Of  MOOT  And  MAUT  .  69 

3.2  Algorithm  For  The  MOOT/MAUT  Approach  .  70 

A.  An  Example  Of  The  MOOT/MAUT  Process  .  76 

5.  Summary . 82 

References . £A 

5  An  Application  Of  Multiple  Criteria  Decision  Theory  To 

Electronic  Warfare  Retrofit  Design . 85 

1.  Introduction . £5 

2.  The  Electronic  Warfare  Aircraft  Retrofit  Decision 

Situation . 88 


vii 


Chapter 


Page 

2.1  Specified  EW  Retrofit  Procedure . 90 

2.2  EW  Program  Complications . 96 

3.  Structure  Of  The  EWARD  Decision  Situation . 96 

4.  MOOT/MAUT  Approach  To  EWARD . 113 

5.  Summary  And  Conclusions . 144 

References . 146 

6  Summary,  Conclusions,  And  Recommendations . 148 

1.  Summary . 145 

2.  Conclusions . 146 

3.  Recommendations . 149 

References . 

Appendicies 

Appendix  A  Weakened  Sufficiency  Requirements  For  The 

Multiplicative  Form  Of  Value  Function  . A-1 

Appendix  B  Policy  Equivalence  From  Multiple  Criteria 

Decision  Making  Approaches . B-1 

Appendix  C  Organization  Contributing  To  The  EWARD  Effort  .  .C-1 
Appendix  D  Elicitation  Of  Preference  Structures . D-1 

Eibliography . R-1 


viii 


EXECUTIVE  SUMMARY 


Introduction 

The  ever  increasing  complexity  of  decision  situations  coupled  with 
the  requirement  to  cope  with  the  political,  economic,  social  and  tech¬ 
nical  aspects  of  these  situations  has  resulted  in  considerable  interest 
being  given  to  the  multiple  criteria  decision  theory  (MCDT)  approaches 
of  multiple  objective  optimization  theory  (MOOT)  and  multiple  attribute 
utility  theory  (MAUT) . 

MAUT  is  a  branch  of  decision  theory  which  is  designed  to  result  in 
decision  making  aids  for  situations  incorporating  multiple  criteria. 

MOOT  incorporates  a  set  of  techniques  which  were  developed  to  be  compu¬ 
tationally  efficient  optimization  tools  for  problems  involving  multiple 
criteria.  Since  MOOT  and  MAUT  were  developed  for  different  purposes,  it 
is  not  unexpected  that  each  approach  is  proficient  at  different  stages 
in  the  resolution  of  a  decision  situation.  This  difference  in  profi¬ 
ciency  motivates  the  development  of  a  combined  MOOT/MAUT  approach  which 
realizes  increased  efficiency  through  the  utilization,  in  a  complament¬ 
ary  manner,  of  appropriate  parts  of  MOOT  and  MAUT. 

An  appropriate  application  for  the  multiple  criteria  approach  devel¬ 
oped  in  this  research  is  a  specific  military  equipment  acquisition  in¬ 
volving  aircraft  retrofit.  The  retrofit  of  a  particular  aircraft  with 
equipment  designed  for  a  mission  which  the  aircraft  was  not  originally 
designed  to  fly  typically  requires  a  large  systems  effort.  Specifically, 
the  retrofit  of  an  aircraft  with  sophisticated  electronic  warfare  ( EVf ) 
equipment  has  historically  involved  inefficiencies  and  inadequacies  in¬ 
cluding  schedule  and  budgetary  overruns  and  a  lack  of  initially  speci¬ 
fied  final  product  performance.  Development  of  a  useful  combined  MOOT/ 
MAUT  process  seems  a  logical  choice  to  ameliorate  the  difficulties  of 
current  electronic  warfare  aircraft  retrofit  design  (EWARD)  processes 
which  are  not  unique  in  defense  equipment  acquisition. 

The  major  contributions  of  this  effort  are  the  delineation  of 
systems  engineering  process  algorithms  of  MOOT  and  MAUT  (pp  23-32)^9-56 ) ; 
the  development  of  a  combination  MOOT/MAUT  methodology  based  on  the 

ix 


complementary  characteristics  of  both  approaches  (pp  69-77  ) ;  the 
development  of  an  efficient  framework  for  EWARD  through  extension  of  a 
MCDT  approach  to  that  application  (pp  98-143  );  and  the  generation  of  a 
set  of  criteria  for  evaluation  of  alternative  retrofit  systems  in  the 
defense  systems  acquisition  cycle  (pp  98-113  )• 

Approach 

The  dissertation  is  divided  into  two  interrelated  efforts.  The 
first  part  is  concerned  with  examining  two  approaches  to  multiple  cri¬ 
teria  decision  theory  with  a  goal  to  investigate  where  processes  re¬ 
sulting  from  application  of  the  theory  could  be  made  more  efficient. 
First,  MOOT  and  MAUT  are  presented  at  a  theoretical  level,  and  then  the 
process  algorithms  for  the  two  approaches  are  delineated  with  an  analyst/ 
user  orientation.  A  subsequent  comparison  of  the  two  approaches  with 
respect  to  structure,  purpose,  and  function,  shows  that  the  MOOT  approach 
is  particularly  efficient  at  the  optimization  step  in  the  resolution 
of  a  decision  situation,  while  MAUT  is  proficient  at  the  ranking  of 
alternatives/decision  making  step.  The  MOOT  process  was  found  to  often 
need  easily  usable  techniques  for  amalgomating  the  objective  functions 
into  a  scalar  choice  function  and  incorporating  the  preference  structure 
of  the  DM.  The  MAUT  process  was  found  to  be  potentially  troublesome  to 
DMs  because  of  the  extensive  elicitation  process  required  to  form  the 
scalar  scoring  function.  Many  of  the  attributes  of  the  MAUT  process  are 
needs  of  the  MOOT  process.  The  converse  case  of  the  attributes  of  MOOT 
and  needs  of  MAUT  is  also  true.  So  the  results  of  the  above  mentioned 
comparison  motivated  the  development  of  a  joint  MOOT/MAUT  approach.  The 
DELTA  chart  of  Figure  1  shows  the  algorithm  for  this  joint  MOOT/MAUT 
approach.  The  primary  benefit  of  the  combined  MOOT/MAUT  process  over 
the  application  of  either  MOOT  or  MAUT  individually  is  that  an  increase 
in  efficiency  is  realized  as  this  joint  approach  utilizes  the  best  of 
MOOT  in  the  optimization  step  and  the  best  of  MAUT  in  the  decision  making 
step.  This  efficiency  is  realized  in  a  complex  decision  situation  as  a 
savings  in  time  and  resources  through  the  systematic  application  of  the 
part  of  processes  specifically  for  the  purposes  they  are  best  suited. 


Figure  1.  Abbreviated  DELTA  Chart  Of  The 
Combined  MOOT/MAUT  Algorithm 
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The  second  major  accomplishment  of  the  research  is  in  deducing 
whether  or  not  a  MCDT  approach  could  ameliorate  inefficiencies  extant  in 
a  particular  defense  systems  equipment  acquisition.  The  specific  appli¬ 
cation  entailed  applying  the  combined  MOOT/MAUT  approach  to  an  EWARD 
situation  in  the  Conceptual  Phase  of  the  Defense  Systems  Acquisition 
Cycle.  A  pre-analysis  phase  was  conducted  in  which  three  primary  groups 
of  stakeholders  were  identified.  These  groups  were  the  operations  group, 
the  government  policy  group,  and  the  technical  development  and  assess¬ 
ment  group  within  the  U.S.  Air  Force. 

A  set  of  twenty-one  decision  makers  (DM's)  and  advisors  from  the 
three  groups  identified  above  volunteered  to  take  part  in  this  effort. 
These  participants  were  individuals  'who  were  currently  involved  in  the 
design,  production  and  procurement  of  EW  equipment.  Interaction  with 
the  participants  was  through  a  series  of  interviews.  As  expected,  the 
objectives  identified  by  the  participants  were  found  to  be  non-commen- 
surable  in  the  sense  that  no  common  measure  (cost,  volume,  etc.)  could 
be  found.  With  the  interaction  of  the  DMs  and  advisors  from  the  three 
stakeholder  groups,  a  set  of  criteria  which  included  the  salient  attri¬ 
butes  of  EWARD  was  established  (Table  1).  A  set  of  alternative  systems 
indicating  the  impacts  of  retrofitting  the  alternative  systems  with 
respect  to  levels  of  the  attributes  was  obtained  from  government  and 
industrial  sources.  Data  used  in  our  example  has  been  modified  to  in¬ 
corporate  the  realism  of  a  retrofit  situation  without  identifying  speci¬ 
fic  equipment.  Preferences,  utilities,  and  minimum  acceptable  attain¬ 
ment  levels  of  the  attributes  were  elicited  from  the  groups  to  be  used 
in  the  MOOT/MAUT  process.  Through  utilization  of  the  MOOT/MAUT  process, 
the  decision  making  group  was  able  to  identify  an  optimal  alternative 
in  an  expedient  manner.  A  validation  exercise  was  performed  on  an  actu¬ 
al  system  now  in  use  to  corraborate  the  developed  EWARD  approach  as  an 
efficient  process  for  identifying  a  satisfactory  retrofit  configuration. 

Two  important  features  seen  in  this  application  effort  are  that 
this  application  methodology  makes  provisions  for  participation  of 
decision  makers,  advisors,  and  experts  at  an  early  phase  of  EWARD,  and 
the  methodology  used  is  flexible  enough  to  be  applicable  to  any  EWARD 


Table  1 


Criteria  for  an  EW  Retrofit  System 


1.  Technical:  EW  Aircraft  Aerodynamic  Performance 

a.  EW  System  Weight 

b.  EW  System  Volume  Required 

c.  EW  System  Power  Required 

2.  Economic:  EW  Retrofit  System  Life  Cycle  Cost 


3.  Military:  Retrofit  System  Electronic  Warfare 
Performance 

a.  Aircrew  Performance 

b.  Nurrber  of  Threats  Degraded 

c.  Nurrber  of  Threats  Defeated 


4.  Political:  National  Policy  Satisfaction 
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of  the  near  future.  An  EWARD  can  be  accomplished  by  use  of  the  attribute 

template  determined  in  this  research  together  with  the  MOOT/MAUT  algor¬ 
ithm  which  was  developed. 

Conclusions 

Based  on  this  research,  the  following  conclusions  can  be  drawn: 

-  While  there  are  operational  and  philosophical  differences  between  MOOT 
and  MAUT,  both  processes  are  mental  constructs  to  approaching  decision 
situations,  and  when  they  are  compared  at  the  same  level,  there  are 
for  all  intents  and  purposes,  no  essential  differences  in  structure 
between  them.  At  the  application  level,  both  MOOT  and  MAUT  approaches 
will  allow  identification  of  a  strategically  equivalent  optimal  policy, 
assuming  the  DM  is  consistent  and  the  NDSS  is  complete. 

-  The  complementary  phases  of  MOOT  and  MAUT  are  compatible  for  combina¬ 
tion  into  a  single  methodology. 

-  A  MCDT  approach  has  merit  in  an  EWARD  application,  particularly  in  the 
early  stages  of  this  application.  The  combined  MOOT/MAUT  approach 
should  increase  the  efficiency  of  EWARD  in  a  comprehensive  manner  for 
an  overall  time  and  resource  savings.  Table  2  lists  the  impacts  of 
this  EWARD  application  as  determined  in  this  research.  An  optimal 
system  configuration,  (no.  S,  Table  5,  Chapter  5)  was  identified  in  a 
timely  manner. 

-  The  multiplicative  form  of  scoring  function  for  evaluation  of  alter¬ 
native  configurations  is  an  appropriate  form  in  EWARD  to  insure 
sensitivity  of  the  scoring  form  to  small  differences  in  the  alter¬ 
natives. 

-  The  experimental  subject  group  used  in  this  research  viewed  the  MOOT/ 
MAUT  framework  presented  as  an  acceptable  and  desirable  approach  to 
this  specific  defense  systems  equipment  acquisition  situation  (EWARD). 

-  Careful  assessment  of  preferences  and  cooroboration  of  the  scaling  con¬ 
stants  in  the  aggregated  utility  functions  of  DMs  and  advisors  is  cri¬ 
tical  to  identify  the  optimal  system  configuration  correctly. 
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Recommendations 


Based  on  this  research  and  application  effort,  the  following 
recommendations  are  offered: 

-  A  combined  MOOT/MAUT  methodology  should  be  implemented  in  EWARD  in 
the  Conceptual  Phase  of  the  Defense  Systems  Equipment  Acquisition 
Cycle.  This  process  should  be  implemented  utilizing  the  available 
analytic  and  technical  staffs  of  the  identified  stakeholder  groups. 

For  convenience,  it  is  suggested  that  these  staffs  be  organized  in  a 
single  team  mode  under  the  direction  of  the  Office  of  the  Secretary 
of  Defense. 

-  The  set  of  developed  criteria  should  be  utilized  in  EWARD  as  a  compre¬ 
hensive  means  to  evaluate  retrofit  system  configurations. 

As  a  result  of  our  efforts,  we  can  identify  the  following  areas  of 
further  research.  There  is  a  need  to  further  develop  techniques  for 
selection  of  the  optimal  policy  from  a  non-dominated  solution  set  in 
ways  that  facilitate  decision  maker-analyst  interaction.  On  the  whole, 
this  important  area  has  received  little  effort  from  the  MOOT  advocates. 
Another  area  for  further  investigation  concerns  the  need  for  more  ade¬ 
quate  modelling  of  the  behavioral  aspects  of  decision  situations  so  that 
by  incorporating  a  DM’s  cognitive  style,  there  would  result  increased 
DM  acceptability  of  the  analytic  approach  and  the  results.  Additional 
research  aimed  at  examining  mathematically  the  preference  space  at  pre¬ 
optimization  (for  MAUT}  and  post-optimization  (for  MOOT)  would  aid  in 
the  steps  of  modelling,  ranking  alternatives,  and  decision  making  for 
multiple  criteria  decision  situations.  Efforts  are  also  needed  to  fur¬ 
ther  characterize  the  stated  objective  of  national  policy  satisfaction  as 
it  relates  to  EWARD. 
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GLOSSARY 


Activity  -  Specific  utilization  of  resources  in  accordance  with  a  policy 
or  decision 

Advisor  -  An  individual  who  is  utilized  in  an  advisory  capacity  by  a 
decision  maker 

Alternative  -  A  candidate  course  of  action 
(Alternative  Solution) 

(Alternative  Action) 

Attribute  -  The  performance  measures  of  objective  attainment  measured 
on  outcomes 

Consistent  Decision  Maker  -  The  preference  structure  of  the  decision 

maker  is  identical  throughout  the  resolu¬ 
tion  of  the  decision  situation 

Constraints  -  The  restrictions  generally  concerning  resources  which 
cause  the  necessity  of  optimizing 

Criterion  -  A  standard,  rule,  or  test  by  which  a  judgment  can  be  formed 
on  the  goodness  of  an  alternative  solution;  an  objective 
function  or  cost  function  can  be  used  as  a  criterion 

Decision  -  An  allocation  of  resources  by  the  decision  maker  as  a  solu¬ 
tion  to  the  decision  situation;  it  is  an  expression  of 
preference  for  a  particular  alternative  from  a  class  of 
alternatives 

Decision  Maker  -  An  individual  who  has  the  authority  to  make  a  policy 
decision,  and  implement  activities  concerning  that 
decision 

Defeat  (a  threat)  -  Render  a  threat  system  inoperable 

Degrade  (a  threat)  -  to  reduce  effectiveness  of  the  threat  system  by 

some  degree 

Element  -  A  constituent  part  of  the  decision  situation  (i.e.,  objective, 
alternative,  decision  maker,  etc. ) 

Event  -  An  occurrence  that  is  characterized  as  a  state  of  nature 

Non-dominated  (non-inferior)  -  The  form  of  the  efficient  solution 
solution  space  space  which  results  from  optimization 

of  a  vector  criteria  of  a  realistic 
problem  with  conflicting  objectives. 

An  allocation  of  resources  is  non- 
dominated  if  no  other  reallocation 
of  resources  will  increase  the  value 
of  any  of  the  constituent  criterion 
without  decreasing  the  value  of  at 
least  one  component  criterion 
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Objective  -  An  incentive  which  reflects  the  value  system  of  the  decision 
maker  and  upon  which  the  decision  situation  is  based;  an 
objective  is  expressible  as  the  "infinitive  to  plus  a  verb 
plus  an  object" 

Objective  function  -  A  criterion  in  functional  form  made  up  of  attri- 
(Cost  function)  butes  which  is  used  to  evaluate  candidate  solu¬ 

tions 

Objective  (or  Goal)  -  The  attributes  of  a  decision  situation 
Measures 

Outcome  -  A  consequence  of  a  decision  which  is  a  combination  of  alter¬ 
natives  and  events;  the  outcomes  characterize  the  "state" 
in  certain  decision  situation  formulations 

Pareto  optimality  -  A  solution  is  Pareto  optimal  when  the  solution  is 

adjusted  to  the  point  such  that  no  change  can  be 
made  to  increase  the  utility  of  any  individual  with¬ 
out  decreasing  the  utility  of  others 

Pre-analysis  phase  -  The  initial  efforts  in  decision  situation  resolu¬ 
tion  composed  of  the  steps  of  problem  definition, 
value  system  design,  and  system  synthesis 

Preference  -  A  ranking  dependent  on  one’s  opinion  or  choice 

Risk  -  The  stochastic  situation  where  the  probability  density  function 
of  the  states  of  nature  is  known 

Structure  of  a  decision  -  The  identification  and  organization  of  corn- 
situation  ponents  or  elements  of  the  decision  into  a 

framework  or  situation  model  for  determining 
the  optimal  course  of  action 

Threat  -  An  opposing  weapon  system 

Quantifiable  impact  -  An  impact  which  has  a  direct  numerical  measurement 

(i.e.,  volume,  temperature,  etc.) 

Utility  -  The  usefulness  of  something  or  satisfaction  derived  from 

something;  an  individual  expresses  cardinal  utility  when  he  or 
she  assigns  to  an  item  a  number  representing  the  amount  or 
degree  of  utility  associated  with  it.  ordinal  utility  re¬ 
quires  an  individual  to  assign  numbers  to  items  which  only 
provide  a  ranking  or  ordering  of  preferences  for  those  items 

Value  -  the  worth  or  desirability  of  a  thing  as  evaluated  by  the  deci¬ 
sion  maker 

Value  Function  (Cardinal)  -  A  mathematical  function  which  relates  the 

worth  of  something  to  the  decision  maker 
*  in  a  way  which  is  measurable  and  order  pre¬ 

serving  up  to  a  positive  linear  transforma¬ 
tion 
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CHAPTER  1 


A  PERSPECTIVE  ON  MULTIPLE  CRITERIA  DECISION  MAKING 

1 .  Introduction 

Policy  and  decision  makers,  at  all  levels  of  authority  in  all  seg¬ 
ments  of  the  public  and  private  sector,  are  confronted  with  a  variety 
of  decision  situations.  Decision  and  policy  analysts  are  constantly 
seeking  better  techniques  to  aid  the  DM  to  resolve  these  decision 
situations  in  an  efficient  manner.  Complex  decision  situations  should 
generally  be  approached  using  a  multiple  criteria  format  since  there  are 
often  issues  from  the  technical,  social,  economic,  legal,  political, 
military  and  other  sectors  which  need  to  be  considered.  Analysts  who 
aid  DMs  have  often  approached  multiple  criteria  decision  situations 
using  either  of  two  methods:  multiple  objective  optimization  theory 
(MOOT)  and  multiple  attribute  utility  theory  (MAUT).  These  two  ap¬ 
proaches  are  discussed  by  Cochrane  and  Zeleny  (1973)  and  MacCrimmon 
(1973). 

These  two  approaches  require  a  structuring  of  the  decision  situa¬ 
tion.  This  structuring  process  generally  consists  of  identifying  and 
organizing  components  and  factors  of  the  decision  situation  into  a 
framework  or  situational  model  for  determining  an  optimal  course  of  ac¬ 
tion  (Sage  and  Rajala,  1978).  The  systems  engineering  methodology  of 
Hall  (1969)  has  provided  a  useful  framework  for  the  structuring,  design, 
and  analysis  of  large-scale  systems.  Certain  of  the  steps  in  Hall's 
framework  can  be  accomplished  utilizing  either  MOOT  or  MAUT  to  produce 
an  optimal  solution.  This  leads  us  to  investigate  the  processes  in¬ 
volved  when  utilizing  either  approach  (MOOT  or  MAUT)  in  order  to  compare 
them  critically  with  respect  to  structure,  function,  purpose,  and  organ¬ 
izational  implication.  Our  investigation  of  MOOT  and  MAUT  is  motivated 
by  a  desire  to  combine  the  best  of  both  processes  for  a  more  efficient 
multiple  criteria  decision  making  approach.  This  resulting  combined 
MOOT/MAUT  approach,  especially  after  fuller  development  to  include  de¬ 
tailed  treatments  of  risk,  stochastic  dominance,  and  other  affects, 
should  have  application  in  a  number  of  large-scale  decision  situations. 


This  combined  MOOT/MAUT  approach  will  be  applied  to  an  electronic 
warfare  aircraft  retrofit  design  (EWARD)  problem.  This  application 
effort  will  be  aimed  at  producing  planning  and  design  prospectives  for 
EWARD  type  issues.  The  retrofitting  of  special  purpose  military  air¬ 
craft  is  a  large-scale  problem  because  of  the  political,  economic,  and 
technical  overtones.  Previous  retrofitting  approaches  considering  pri¬ 
marily  the  technical  aspects  of  the  problem  have  only  met  with  limited 
success  (Peterson,  Hays,  and  O'Conner,  1975). 

In  this  chapter,  a  discussion  of  the  characteristics  of  any  general 
decision  situation  is  presented  following  a  discussion  of  related  ef¬ 
forts.  Next,  a  section  on  multicriteria  approaches,  including  an  intro¬ 
duction  of  the  two  approaches  of  MOOT  and  MAUT,  is  presented  followed 
by  a  discussion  of  the  systems  engineering  methodology.  The  purpose  of 
this  research  is  not  to  present  theoretical  or  pragmatic  discussions 
concerning  development  of  a  DM's  value  system  or  elicitation  of  an 
associated  preference  and  utility  structure  as  there  are  examples  of 
these  in  the  literature.  Our  effort  is  aimed  at  incorporating  the  re¬ 
sults  of  a  value  system  and  preference/utility  elicitation  into  a  MCDT 
structure  for  the  development  of  an  efficient  decision  making  framework, 
and  this  part  of  the  effort  is  emphasized. 

Related  Efforts 

Previous  efforts  concerned  with  the  resolution  of  decision  situa¬ 
tions  involving  multiple  criteria  have  generally  concentrated  on  one  or 
the  other  of  MOOT  and  MAUT  as  evidenced  by  the  literature.  Cohon  and 
Marks  (1975)  divide  the  popular  optimization  techniques  into  classes 
which  can  be  used  for  formulation  of  multiobjective  solutions.  Slovic, 
Fischhoff,  and  Lichtenstein  (1977)  provide  insight  into  the  many  facets 
of  both  normative  and  descriptive  behavioral  decision  theory.  Huber 
and  Johnson  (1977)  and  Edwards  (1977)  provide  outlines  for  modelling  and 
optimizing  MAUT  situations.  The  decision  making  process  in  terms  of 
MCDM  is  discussed  by  Starr,  et  alv(1977).  Brown  and  Ulvila  (1976)  seg¬ 
ment  decision  problems  'under  three  taxonomic  headings  of  decision  situa¬ 
tion,  analysis,  and  performance  measure.  Cochrane,  et  al.  (1973), 


discuss  several  variations  of  both  MOOT  and  MAUT  techniques.  The  effect 
of  hierarchial  decision  making  on  the  organization  is  discussed  by 
Banker  and  Gupta  (1978).  Merkhofer  (1977)  discusses  the  concept,  advan¬ 
tages,  and  value  of  flexibility  in  a  decision  situation.  The  works  of 
Keeney  and  Raiffa  (1976),  and  Raiffa  (1968)  are  decision  analysis 
classics  concerning  MAUT. 

The  unclassified  literature  on  the  EWARD  application  is  well  repre¬ 
sented  in  the  work  of  Peterson,  Hays,  and  O'Connor  (1975)  and  Cook 
(1977).  This  effort  is  aimed  at  suggested  modelling  formulations  for  a 
multiple  criteria  decision  theory  (MCDT)  approach  to  electronic  warfare 
equipment  selection. 

The  systems  engineering  concepts  of  Hall  (1969),  Hill  and  Warfield 
(1972),  Gibson  (1977),  and  Sage  (1977)  influenced  the  philosophical  ap¬ 
proach  to  the  decision  situation  research  and  EWARD  application  effort. 

2.  The  Decision  Situation 

A  decision  situation  contains  a  set  of  elements  which  are  dependent 
on  the  circumstances  of  the  problem  facing  a  decision  maker  (DM).  These 
elements  are  utilized  in  the  pursuit  or  selection  of  a  decision  alterna¬ 
tive  as  a  solution  to  a  problem.  The  decision  situation  is  composed  of 
various  components  surrounding  the  problem  such  as  the  internal  organi¬ 
zation,  external  (physical)  environment,  and  rationale  for  determining 
decisions.  The  selection  and  implementation  of  an  appropriate  (optimal) 
policy  is  the  desired  resolution  of  a  decision  situation.  As  one  of  the 
first  steps  in  a  decision  aiding  effort,  the  analyst  attempts  to  struc¬ 
ture  and  model  the  decision  situation  incorporating  the  DM's  value  system. 
Figure  1  shows  some  elements  of  a  typical  decision  situation  and  the 
steps  of  the  systemic  process  which  will  be  used  in  the  evolution  of  a 
choice  making  strategy. 

3.  Multicriteria  Decision  Making 

The  term  "multiple  criteria  decision"  is  applied  to  a  decision 
problem  involving  either  multiple  objectives  or  multiple  attributes. 

There  is  a  need  for  MCDT  in  numerous  fields  and  applications  areas 
(Keefer,  1973;  Edwards,  1977;  and  Slovic,  et  al.,  1977).  A  vector  of 


3 


5 


-  Alternatives 

-  Preferences 

-  Constraints 

-  Attributes 

-  Activities 

-  Objectives 

-  Stakeholders 

-  Structure 

-  Resources 

-  Outcomes 


Elements 

Systems 

Engineering 

Phases 

-  Complexity 

-  Personnel 

-  Facilities 

-  Time 

-  Flexibility 

Input  description 
and  specification 
-Problem 
definition 
•Value  system 
design 

-System  Synthesis 

1 

-  Costs 

p 

i  Impact  Assess- 

t  merit. 

-  Planning 

hSystem  analysis 
•  and  modelling 

Horizon 

* 

[-Optimization 

i 

,  ! 

Information  i 


Decision  Situation  Description 


objectives,  for  either  MOOT  or  MAUT  is  needed  because  of  the  need  to 
consider  multiple  non-pecuniary  and  non-conznensurate  objectives  (Haimes, 
Hall,  and  Freedman,  1975).  Even  when  fundamentally  independent  objec¬ 
tives  are  combined  in  a  decision  situation  with  limited  resources,  the 
objectives  become  dependent  and  often  conflicting  with  respect  to  purpose. 
Single  criterion  models  and  techniques,  which  often  consider  economic 
objectives  only,  are  not  adequate  in  contemporary  government,  business, 
industrial,  and  societal  decision  situations  which  require  inclusion  of 
non-pecuniary  objectives  (Hoos,  1972;  Sutherland,  1978;  Haimes,  Hall  and 
Freedman,  1975).  The  political,  economic,  social,  and  technical  ramifi¬ 
cations  of  large-scale  system  decisions  require  inclusion  of  pertinent 
attributes  and  the  value  system  of  the  stakeholders  for  truly  satisfac¬ 
tory  problem  resolution.  Systems  Engineers  attempt  to  fill  the  void  be¬ 
tween  idealistic  mathematically  tractable  decision  theoretic  problems 
and  the  complex  multidiscipline  real  world  situation  of  the  modern  day 
decision  maker  in  order  to  evolve  a  set  of  tools  and  techniques  which 
can  provide  contextural  solutions  to  decision  situations. 

Many  systems  research  efforts  are  devoted  to  refinement  of  various 
optimization  techniques  for  application  to  large-scale  systems.  Large- 
scale  issues  with  political,  economic,  technical,  social,  legal,  mili¬ 
tary,  and  environmental  concerns  require  significant  efforts  for  design 
and  analysis  if  there  is  to  be  any  hope  of  satisfactory  issue  resolu¬ 
tion  from  the  use  of  systemic  aids.  Two  MCDT  procedures  for  approaching 
a  large-scale  decision  situation  are  multiple  objective  optimization 
theory  (MOOT)  (Besson  and  Meisel,  1971;  Geering,  1971;  Hoy,  1971; 

Cochrane  and  Zeleny,  1973;  Cohon  and  Marks,  1975;  Meisel  and  Payne, 

1975;  Payne  and  Polak,  1976;  Haimes,  1977;  Eliasberg,  1978;  Tabak,  1976; 
Wismer  and  Chattergy,  1978);  and  multiple  attribute  utility  theory 
(MAUT) (Miller,  1967;  Raiffa,  1968;  MacCrimmon,  1973;  Winderfeldt  and 
Fischer,  1973;  Keeney  and  Raiffa,  1976;  Edwards,  1977;  Farquhar,  1977; 
Greenwood  and  Starr,  1977;  Huber  and  Johnson,  1977;  Sage,  1977; 

Keefer,  1978). 
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Two  Approaches  to  MCDT 


The  MCDT  approaches  of  MOOT  and  MAUT  can  both  be  utilized  in  a 
normative  manner,  which  makes  them  suited  for  identifying  policies 
which  are  aimed  at  providing  solutions  to  decision  situations.  These 
MCDT  approaches  are  comprehensive  techniques  for  complex  decision  situa¬ 
tions  . 

The  MOOT  approach  is  concerned  with  generating  non-dominated  solu¬ 
tions  to  a  vector  of  objective  functions.  Information  from  a  pre¬ 
analysis  effort  is  used  to  identify  a  vector  of  value  functions  which 
are  then  optimized  using  an  appropriate  technique.  The  results  of  this 
optimisation  process  generally  represent  one  or  more  sets  of  "efficient" 
solutions  from  which  the  DM  subsequently  chooses  the  "best  optimum". 

This  last  action  of  "best  optimum"  selection  by  the  DM  has  not  received 
a  proportional  amount  of  attention  as  has  the  optimization  techniques. 

The  MAUT  approach  requires  the  analyst  to  elicit  preference  infor¬ 
mation  from  the  DM  concerning  the  relative  importance  of  attributes  of 
proposed  alternative  policies.  This  information  is  used  to  formulate  a 
scalar  social  choice  function  which  is  used  to  score  alternative  poli¬ 
cies.  MAUT  seeks  to  rank  alternatives  based  on  the  decision  makers 
utility  for  the  outcomes  or  attributes  of  these  alternatives.  MAUT, 
therefore  is  intended  primarily  to  be  a  decision  making  aid. 

While  neither  approach  is  entirely  new,  the  development  efforts 
for  both  approaches  have  not  reached  full  maturation  (Starr  and  Zeler.ey, 
1977). 

4.  Systems  Engineering  Methodology 

Our  research  and  application  efforts  will  concentrate  on  certain 
steps  of  the  morphological  framework  of  Hall  : 1 969 ) .  The  logic  axis  of 
this  structure  is  divided  into  seven  steps.  The  first  three  steps 
(problem  definition,  value  system  design,  system  synthesis)  are  a  norma¬ 
tive  approach,  as  mentioned  by  Hall  (1969),  Hill  and  Warfield  (1972), 
and  Sage  (1977)  to  general  large-scale  systems  problems.  These  steps 
supply  the  input  description  and  specification.  The  system  analysis 
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(and modelling)  step  develops  interrelationships  and  characteristics  cf 
alternatives  so  as  to  produce  the  basis  for  an  impact  assessment.  Our  re¬ 
search  is  concentrated  on  the  next  two  steps  in  the  system  methodology . 
Objective  functions  are  optimized  with  respect  to  the  outcome  states  in 
the  optimization  step.  The  DM  selects  the  "optimum"  policy  in  the 
decision  making  step.  These  aforementioned  steps  accomplish  parts  of 
the  impact  assessment  and  output  specification  for  the  system.  There  is 
a  large  variety  of  optimization  and  decision  making  techniques  which  can 
be  applied,  and  these  different  approaches  car.  yield  similar  results  at 
times  (Keeney  and  Kirkwood,  1977;  Gres,  1975;  and  Tell,  1976). 

It  is  noted  that  no  matter  which  approach  is  used  for  the  decision 
process  in  a  systems  effort,  the  common  action  oriented  phase  of  pro¬ 
ducing  a  transition  scenario  is  of  utmost  importance  to  exploit  the  re¬ 
sults  of  the  effort  for  maximum  benefit  as  discussed  by  Gibson  (1977, 
1979).  The  plan  for  action  step  accomplishes  the  task  of  optimal 
policy  interpretation  and  implementation.  All  the  steps  would, of  course, 
be  iterated  in  each  phase  until  satisfactory  results  are  obtained. 

In  a  decision  situation,  the  analyst  generally  seeks  a  methodolog¬ 
ical  framework  for  efficient  structuring  of  the  factors  into  a  model  to 
aid  thu  DM  in  selecting  and  implementing  the  best  alternative  course  of 
action.  The  system  engineering  morphological  framework  is  a  valuable 
tool  for  the  execution  of  a  systematic  analysis  of  a  MCDT  situation  in 
coordination  with  the  DM. 

5.  Dissertation  Organization 

Our  purpose  in  this  research  is  to  motivate  and  present  a  more 
efficient  MCDT  approach  which  combines  features  of  the  MOOT  and  MAUT 
approaches.  We  concentrate  on  the  optimization/ranking  cf  alternatives 
and  decision  making  steps  of  the  systems  engineering  methodology  in  our 
efforts.  This  combined  MOOT/MAUT  approach  is  applied  to  an  electronic 
warfare  retrofit  problem  to  produce  a  design  framework. 

In  Chapter  2,  we  present  MOOT  at  the  theoretical  and  practice 
levels  as  a  way  of  establishing  a  basis  of  comparison  with  MAUT. 
the  practice  level,  MOOT  is  delineated  in  the  systems  engineering 
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framework.  In  Chapter  3,  MAUT  is  also  presented  at  the  theoretical  and 
practice  levels.  Following  the  description  of  MAUT  at  the  practice 
level  in  the  systems  engineering  framework,  an  example  is  presented  from 
the  welfare  economics  area.  This  example  points  out  relationships  be¬ 
tween  MOOT  and  MAUT.  Building  on  the  efforts  in  Chapters  2  and  3,  a  com¬ 
parison  of  MOOT  and  MAUT  is  presented  in  Chapter  4.  The  combined  MOOT/ 
MAUT  approach  is  then  presented  followed  by  an  example  illustrating  its 
use.  In  Chapter  5,  this  combined  approach  is  applied  to  the  EWARD  prob¬ 
lem  with  the  purpose  of  producing  a  design  framework  and  set  of  criteria 
with  which  to  use  in  this  type  of  equipment  acquisition  effort.  Chapter 
6  presents  the  summary  and  conclusions  of  the  dissertation  and  sugges¬ 
tions  for  further  research. 


6.  Summary 

An  introduction  to  the  proposed  research  was  presented  in  this 
chapter.  An  overview  of  MCDT  was  presented  through  an  introduction  tc 
MOOT  and  MAUT.  The  related  efforts  and  contributions  of  other  re¬ 
searchers  and  authors  were  enumerated,  followed  by  a  general  charac¬ 
terization  of  a  decision  situation.  Finally  the  application  effort  of 
EWARD  was  introduced,  and  the  remainder  of  the  dissertation  was  dis¬ 
cussed  . 
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CHAPTER  2 


MULTIPLE  OBJECTIVE  OPTIMIZATION  APPROACH  TO  DECISION  SITUATIONS 

1 .  Introduction 

Resolution  of  a  complex  decision  situation  can  be  approached  using 
multiple  criteria  decision  theory  (MCDT)  (Starr  and  Zeleny,  1977; 
MacCrimmon,  1973).  Two  approaches  to  MCDT  for  problem  solving  are 
multiple  objective  optimization  theory  (MOOT)  and  multiple  attribute 
utility  theory  (MAUI).  In  this  effort,  MOOT  is  presented  at  the  theoret¬ 
ical  level  and  at  the  practical  application  level  for  various  types  of 
decision  situations.  In  the  following  work,  we  discuss  MAUT  and  a  com¬ 
bined  MOOT/MAUT  approach  designed  to  preserve  the  most  advantageous  fea¬ 
tures  of  each  approach.  The  MOOT  discussion  is  presented  from  a  multiple 
alternative  viewpoint  and  this  allows  one  to  make  several  observations 
about  dominance  and  other  concepts  that,  while  not  entirely  original,  are 
not  usually  considered  within  the  context  of  multiple  objective  optimiza¬ 
tion  theory.  The  MOOT  presentation  is  followed  by  a  simple  welfare 
economics  example  which  illustrates  how  the  HOOT  process  is  applied  to  a 
decision  situation.  This  same  illustrative  example  will  be  used  for  the 
HA'  '?  cujd  MOOT/MAUT  approaches  to  facilitate  comparison  of  these  ap¬ 
proaches  to  decision  situation  resolution. 

2.  MOOT  At  The  Theoretical  Level 

MOOT  is  an  optimization  method  for  generating  optimum  solutions  for 
the  alternative  acts  which  extremize  a  vector  of  performance  indices. 

This  vector  of  performance  indicies  or  objective  functions  is  optimized 
with  respect  to  each  component  of  the  vector  performance  index.  A  num¬ 
ber  of  authors  discuss  computational  features  of  various  algorithms  for 
accomplishing  this  including  Cohon  and  Marks  (1975).  This  optimization 
of  vector  objective  elements,  when  combined  with  a  check  for  dominance, 
can  be  used  to  generate  a  non-dominated  solution  set  ( NDSS  .  A  specific 
solution  alternative  is  a  non-dominated  solution  (or  Pareto  optimal 
solution)  if  it  is  not  dominated  by  another  solution  alternative. 
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Policy  or  alternative  act  A^  dominates  policy  or  alternative  k.  if  the 
n  vector  of  performance  objectives  or  attributes  for  act  A.,  which  we 
will  call  v1  is  such  that  each  component  of  the  vector,  denoted  for 
k  =  1,2,,,n,  is  greater  than  or  equal  to  (with  at  least  one  component 
strictly  greater  than)  the  corresponding  component  of  the  performance  ob 
jective  vector  for  act  A.  which  we  denote  vP. 

Within  the  context  of  an  attribute  hierarchy,  the  concept  of  dom¬ 
ination  is  interpreted  as  follows.  We  consider  the  attribute  tree  of 
Figure  1 .  A  line  is  drawn  through  the  hierarchy  that  separates  or  di¬ 
vides  upper  level  attributes  from  lower  level  attributes.  Nodes  inter¬ 
sected  by  these  lines  are  presumably  salient  attribute  nodes  for  policy 
comparison.  If  an  alternative  policy  A^  has  an  attribute  value  at  each 
salient  attribute  node  that  is  at  least  as  good  as  the  attribute  value 
of  another  alternative  policy  A2  for  each  corresponding  salient  node, 
and  if  A1  has  one  or  more  attribute  values  that  are  better  than  the 
corresponding  A2  values,  then  it  will  be  said  that  alternative  act  A, 
dominates  A2  (A^  >  A2),and  therefore  A2  can  be  eliminated  from  further 
consideration  to  determine  the  optimal  policy.  If  an  objective  hier¬ 
archy  is  decomposed  into  many  levels,  it  is  very  likely  that  there  ex¬ 
ists  a  sufficiently  low  level  at  which  no  alternative  can  be  dominated 

* 

by  any  of  the  others  and  therefore  the  decision  situation  cannot  be  re¬ 
solved  at  this  lowest  level  by  alternative  elimination  using  dominance 
concepts.  Therefore,  it  is  convenient  to  choose  a  sufficiently  high 
level  in  the  hierarchy  of  objectives  so  that  alternative  policy  domina¬ 
tion  can  be  established  but  not  so  high  that  there  is  great  axiologic 
difficulty  in  determining  objectives  measures.  The  set  of  performance 
criteria  chosen  to  represent  value  system  design  for  the  decision  situa¬ 
tion  is  a  conceptual  set  based  on  perceptions  of  the  decision  maker  (DM) 
Therefore,  a  permissible  set  of  salient  criteria  is  not  limited  to  a 
horizontal  level  set  in  the  objective  hierarchy  (i.e.,  level  A  or  B  in 
Figure  1),  but  can  include  performance  criteria  from  various  levels 
(e.g.,  level  C).  The  consequence  of  the  multilevel  dominance  is 

#This  makes  a,  perhaps  utopian, assumption  that  there  must  be  something 
good  in  everything. 


Figure  1  .  Hierarchial  Objective/Attribute  Levels  For 
Large  Seale  Decision  Situation 


summarized  by  the  following  statement:  once  an  alternative  policy  is 
dominated  by  a  second  alternative  policy,  it  will  remain  dominated  as 
one  moves  to  upper  levels  in  the  objectives  hierarchy.  This  statement 
is  not  necessarily  true  as  one  moves  from  a  higher  to  a  lower  level. 
Elimination  of  all  dominated  solutions  or  acts  from  the  initially  pro¬ 
posed  set  of  alternatives  leaves  the  NDSS.  HOOT  has  traditionally  been 
concerned  with  generation  of  the  NDSS  or  a  nondominated  frontier  of 
solutions,  each  of  which  is  optimum  in  a  sense.  This  NDSS  is  often 
called  the  Pareto  optimal  set  or  Pareto  frontier.  This  discussion 
asserts  an  often  overlooked  but  useful  fact  that  the  acts  contained  in 
the  NDSS  will  be  very  much  a  function  of  the  hierarchial  level  at  which 
policy  comparisons  are  made.  This  is  a  very  useful  concept  for  success¬ 
ful  use  of  MOOT  concepts. 

2.1  MOOT  -  NON-STOCHASTIC/TIME  INVARIANT  CASE 

The  theoretical  multiple  objective  optimization  problem  for  the 
deterministic  or  non-stochastic  and  time  invariant  or  static  case  is  posed 
as  a  vector  criterion  optimization  problem.  Consider  a  policy  vector, 
a,  and  a  policy  outcome  state  or  event  vector,  x.  An  objective  vector 
is  described  by  j(x,a)  =  J  where  the  components  are  element  objective 
functions.  The  constraints  are  described  by  a  vector  equality  set 
f(x,a)  =  0  and  an  inequality  set  g(x,a)  <_  0.  Tne  system  relationship 
between  a  and  x  along  with  representations  or  characterizations  of  for¬ 
bidden  regions  in  policy  act  -  outcome  event  space  make  up  constraint 
components.  The  problem  is  to  maximize  the  performance  objective  com¬ 
ponents  subject  to  the  system  equations  and  constraints.  This  problem 
is  represented  mathematically  as 

maximize  J  =  maximize  j(x,a)  (1) 

subject  to:  f(x,a)  =  0  (2) 

g(x,a)  <  0  O', 

Since  j  is  a  vector,  special  attention  must  be  directed  at  the  meaning 
of  simultaneous  optimization  of  the  components  of  the  vector.  This 
optimization  may  be  accomplished  in  a  "constraint  method,"  "attainment 
method,"  or  goal  programming"  format  (Cohon  and  Marks,  1975)  where  a 


specific  objective  function  element  ( j^)  is  optimized  while  holding  the 
other  cost  function  elements  ( j^)  equal  to  a  constant  (jj  =  jr).  The 
formulation  now  becomes 

maximize  ji(x,a)  (A) 

subject  to:  j-  =  (5) 


fix, a)  =  0  (6) 

glx,a)  <  0  (7) 

where  vis  a  vector  of  all  objective  elements  except  j, .  The  necessary 
conditions  called  the  Kuhn-Tucker  conditions,  (Taha,  1976 )  for  a  to  be 
a  stationary  point  for  each  maximization  are: 

g(x,a)  <_  0  (8) 


fix, a)  =  0 


( 9  ; 


Jrs  Ji 


10; 


aji(x,a)  ajjix.a) 


ag(x,a)  aflx.a; 


aa 


a§ 


x  - 


e  - 


aa 


xTl  Oj  -  jj)  =  0 


=  0 
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(11; 
1 12' 


YT(f (x,a) )  =  0 
e1 (gtx,a) }  =  0 


113} 
1 A ) 
:  151 


where  a  is  the  optimal  policy  and  x  is  the  value  of  the  outcome  states 
for  the  optimal  policy,  x  is  a  Lagrange  multiplier  vector  for  the 
jj  =  3j_  set  of  constraints,  -y  is  a  Lagrange  multiplier  vector  for  the 
fix, a)  =  0  set  of  constraints,  and  e  is  the  Lagrange  multiplier  vector 
for  the  g(a,x)  <  0  set  of  constraints.  This  set  of  equations  is  solved 
many  times  for  different  feasible  values  of  to  generate  a  set  of 
solutions.  Calculations  from  equations  A,  5,  6,  and  7  will  define  the 
limits  of  j-r  to  insure  that  a  specific  jj  is  feasible.  These  equations 
are  solved  for  the  values  of  a  and  x  for  each  3r-  Each  time  j?-  takes  on 
a  specific  value,  the  analyst  uses  the  optimization  process  tc  find  one 
feasible  solution  .(if  the  constraints  are  not  violated)  to  the  original 
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maximization  of  the  j(x,a)  formulation.  The  values  of  can  be  al¬ 
lowed  to  vary  sequentially  over  their  ranges,  or  these  values  can  be 
set  equal  to  a  set  number  of  attainment  levels.  Since  usually  one  or 
more  of  the  objectives  are  non-commensurate  and  conflicting  in  nature, 
no  individual  form  of  a  policy  from  the  set  of  feasible  policies  will 
usually  allow  a  global  optimum  in  the  general  case.  Instead,  an  elimina¬ 
tion  by  dominance  exercise  selects  those  feasible  policies  which  are 
non-dominated  thereby  forming  the  NDSS.  Figure  2  illustrates  the  I'DSS 
for  four  hypothetical  policies  with  respect  to  two  attributes  or  value 
functions  of  the  DM.  Assuming  more  is  preferred  to  less  with  respect 
to  the  attributes,  policy  1  in  Figure  2a  is  dominated  by  policy  2. 

Figure  2b  shows  the  results  of  two  policies  where  neither  is  globally 
dominant.  The  overall  NDSS  is  comprised  of  alternative  forms  of  policy 
3  and  policy  4.  In  the  latter  case,  the  selection  of  the  optional 
policy  can  be  accomplished  by  the  introduction  of  value  judgments  of  the 
DM.  Traditionally,  however,  the  DM ' s  value  judgments  have  net  been  in¬ 
corporated  explicitly  into  MOOT  and  it  is  a  goal  of  this  effort  to  render 
MOOT  approaches  more  useful  at  the  practice  level  by  doing  this. 

2.2  MOOT  -  Time  Invariant/Uncertain  Outcomes 

Very  often,  elements  surrounding  the  decision  situation  are  not 
known  with  certainty.  This  uncertainty  can  generally  be  characterized 
by  probability  distributions  for  outcome  states  associated  with  differ¬ 
ent  possible  events.  The  degree  of  difficulty  in  obtaining  MOOT  prob¬ 
lem  solutions  generally  increases  substantially  by  introducing  proba¬ 
bilistic  notions.  The  general  formulation  is 


max 

J  =  E{  j 

(x,a,0 ) 

;  16) 

subject  to 

f(x,a,u> ) 

=  0 

i  17) 

g(x,a,v ) 

1  0 

;i5) 

where  ?,  w,  and  v  are  realizations  of  random  processes,  and  E  denotes 
expectation.  In  the  general  case,  for  a  continuous  state  representation, 
the  expectation  can  be  conditioned  upon  an  observation.  A  form  which  is 
more  mathematically  tractable  is 
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Figure  2.  Non-Dominated  Solution  Sets 
(Attribute  Vector  =  ( j  , 


max 

J  =  E  ($(x,a! 

1} 

( 19 

subject  to 

f(x,a)  +  u  = 

0 

(20 

g(x,a)  +  v  = 

0 

(21 

Optimization  is  accomplished  after  transforming  these  formulations  into 
the  general  form  of  equations  4,  5,  6,  and  7  through  a  constraint  tech¬ 
nique  or  goal  programming. 

Utilizing  the  concept  of  stochastic  dominance,  the  analyst  may  be 
able  to  rapidly  discern  the  optimal  policy  by  comparing  the  cumulative 
distribution  functions  for  the  various  alternatives.  Stochastic  domi¬ 
nance  is  said  to  occur  if  the  expected  value  of  an  alternative  is  greater 
than  that  of  another  over  a  whole  class  of  value  functions.  For  a  de¬ 
cision  situation  which  is  represented  by  the  decision  tree  of  Figure  3a, 
assume  that  the  set  of  possible  outcomes  is  the  same  for  all  alterna¬ 
tives  and  that  the  outcomes  are  arranged  in  order  of  increasing  goodness 
so  that  the  value  function  for  this  set  of  outcomes  is  a  non-decreasing 
function.  If  one  plots  the  cumulative  probability  distribution  func¬ 
tions  (CDF)  of  the  alternatives  for  the  outcomes,  F^(z),  first  degree 
stochastic  dominance  (FDSD)  is  easy  to  recognize.  Alternative  i  will 
dominate  alternative  j  if  the  CDF 

Fjlz)  >  Fi(z)  i22; 

for  all  outcomes.  In  practice, one  can  easily  recognize  any  CDF  which 
lies  completely  to  the  left  of  another  alternative's  CDF  without  inter¬ 
secting  it.  Figure  3b  illustrates  that  alternative  C  is  dominated  (in 
the  sense  of  FDSD)  by  both  alternatives  A  and  B.  If  the  CDF  curves 
intersect,  FDSD  will  be  inconclusive,  but  second  degree  stochastic  domi¬ 
nance  (SDSD)  may  further  screen  the  set  of  options.  SDSD  requires  the 
DM  to  be  risk  averse  over  the  outputs  (the  utility  function  must  be  con¬ 
cave).  SDSD  states  that  alternative  i  will  dominate  j  if 

[  (Fj(y5  “  Fj/y))<*y>  o  ( 23 > 

Outcomes 

for  all  z.  That  is,  the  area  under  the  F  .(z)  should  not  be  less  than 
the  area  under  F^(z) .  In  Figure  3t  *  it  is  clear  that  area  X  >  area  Y 
and  therefore  alternative  3  dominates  alternative  A  in  the  sense  of  SDSD. 


As  shown,  stochastic  dominance  may  be  helpful  in  MOOT  for  screening 
alternatives  in  certain  decision  situations.  The  theory  for  the  basis 
of  FDSD  and  SDSD  is  discussed  by  Hancock  and  Levy  (1969),  Hadar  and 
Russell  (1969),  and  Bunn  (1978). 

It  is  noted  that  Pareto  optimality  may  not  satisfy  requirements  for 
identical  levels  of  preference  for  consequences  among  individuals  in  a 
decision  situation.  Here  an  identical  level  of  preference  for  two 
individuals  is  defined  as  a  position  for  attributes  which  is  estab¬ 
lished  by  an  identical  trade-off  ratio  for  the  two  individuals  (e.g. ,• 
consider  an  outcome  state  which  is  described  by  a^  units  of  attribute 
A-p  this  outcome  state  value  would  constitute  an  identical  level  of 
preference  for  two  individuals  if  each  would  be  willing  to  trade-off 
exactly  b1  units  of  another  attribute  for  a1  units  of  A..  In  a  deci¬ 
sion  situation,  it  is  possible  that  based  on  identical  levels  of  prefer¬ 
ence,  the  optimal  policy  is  not  necessarily  a  member  of  the  UDSS .  This 
is  of  considerable  concern  in  situations  which  involve  uncertainty  and 
multiple  DMs.  Consider  the  example  of  three  alternatives  with  the  follow¬ 
ing  possible  outcome  states: 


alternative 

1: 

f 

_P  =. 

_ 

—Vl  =  .9;  v2  =  .1 

E(v1 ) 

-  .5 

C 

5  — ■ 

— Vl  -  .1;  v2  =  .9 

EiVg) 

=  .5 

alternative 

2: 

P  = 

i 

v,  =  .3;  v 2  -  -6 

E !  v  1 ) 

=  .3;  E(v2)  = 

alternative 

3: 

P  = 

i 

v i  =  .45;  v2  =  .45 

E'^) 

=  Elv^)  =  .45 

where  v^  =  the  level  of  preference  or  value  of  an  outcome  by  individual 

1  and  E(v^)  is  the  expected  value  of  the  outcome  of  the  specific  alter¬ 
native  for  individual  i.  Based  on  an  expected  value  criteria,  alterna¬ 
tives  1  and  2  are  non-dominated  (clearly  alternative  1  dominates  alter¬ 
native  3).  In  alternative  1,  depending  on  which  event  occurs,  either 
individual  1  is  going  to  receive  a  more  desirable  outcome  and  individual 

2  a  less  desirable  outcome  or  vice-versa.  In  alternative  2,  clearly 
individual  2  is  going  to  receive  a  more  desirable  outcome.  Alternative 

3  is  the  only  alternative  where  both  individuals  are  going  to  receive  the 
same  outcome  based  on  an  identical  level  of  preference,  yet  it  is  not  in 
the  UDSS.  This  illustrates  that  any  choice  from  the  UDSS  may  not  take 
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into  account  identical  levels  of  preference  and  therefore  nor  be  optimal 
with  respect  to  these  equity  considerations.  Therefore ,  one  is  warned 
that  if  equality  with  respect  to  levels  of  preference  for  consequences  is 
of  paramount  importance,  MOOT  does  not  insure  one  of  selecting  the 
optimal  policy. 


2.3  MOOT  -  Non-Stochastic/Time  Varying  Case 


In  the  previous  discussions  of  MOOT,  static  or  single  stage  deci¬ 
sion  problems  were  considered.  MOOT  is  capable  of  incorporating  dynamic 
elements,  that  is  considerations  of  events  evolving  over  time.  In  reality 
many  decision  situations  should  be  modelled  in  this  way.  The  optimiza¬ 
tion  formulations  now  can  be  described  in  terms  of  the  exogenous  varia¬ 
ble,  time  (t).  For  instance,  the  vector  objective  function  can  now  take 
the  form  of 


J  = 


t final 

<t» [ x •  t } ,  ait'., 

* 

"initial 


tldt 


:2a 


where  this  objective  function  gives  an  indication  of  policy  performance 
as  a  function  of  time,  and  the  constraints  may  have  the  form 

x  =  f[x(t) ,  ait) ,  tjdt  25 


X\t. 


initial 


)  =  x. 


Of 


where  is  fixed  and  t^.  ^  may  be  fixed  or  variable  :Sage  and 

White,  1977  ).  This  formulation  is  valuable  to  policy  determination 
because  of  dependency  of  the  state  elements  in  many  decision  situations 
on  time.  Dynamic  optimization  tools,  which  are  utilized  to  determine 
the  optimal  policy  for  a  dynamic  MOOT  forqulation,  are  applied  in  a 
similar  manner  as  the  static  case  in  order  to  identify  and  optimize  the 
non-dominated  policies.  The  effort  required  for  dynamic  optimization 
with  multiple  objectives  is  substantially  greater  than  that  associated 
with  the  static  case.  The  system  dynamics  can  be  formulated  in  contin¬ 
uous  or  discrete  time  representations. 
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2.4  MOOT  -  Outcome  Uncertainty -'Tire  Varying  Case 

A  decision  situation  which  involves  uncertainty  associated  with 
event  outcomes  and  where  event  outcomes  evolve  over-  time  presents  the 
greatest  level  of  complexity  for  a  MOOT  formulation.  The  problem 
formulation  can  now  include  descriptions  of  the  event  outcomes  in  terms 
of  probability  distributions  and  evolution  over  time.  The  solution  form 
on  which  to  base  the  NDSS  is  an  optimal  strategy  which  car.  be  produced 
using  stochastic  optimal  control  theoretic  techniques.  The  probabii- 
istic/dynar.ic  version  of  the  vector  criteria  problem  has  seen  the  leas: 
development  cf  the  MOOT  areas.  Some  of  the  few  efforts  ir.  this  area  are 
in  Markov  decision  processes. 

Regardless  cf  which  of  the  representations  described  in  the  pre¬ 
ceding  sections  is  used,  the  purpose  of  MOOT  is  to  allow  the  analyst  to 
optimize  with  respect  to  the  multiple  criteria  and  to  then  form  the  '..'OSS 
by  eliminating  the  dominated  solution.  This  non-dominated  solution  set 
is  then  presented  to  the  decision  maker  for  selection  cf  the  most  pre¬ 
ferred  solution. 

3.  A  Multiple  Objective  Optimization  Process 

Multiple  objective  optimization  theory  is  currently  the  focus  of 
considerable  research,  and  it  is  likely  that  there  is  disagreement  amor, 
practitioners  and  researchers  concerning  the  bounds  of  this  approach  a: 
the  specific  process  to  use  in  aiding  resolution  of  a  decision  situation. 
While  it  is  basically  an  algorithm  for  optimization  for  later  decision 
making,  many  practitioners  of  multiple  objective  decision  making  include 
all  steps  of  the  systems  engineering  approach  within  the  HOOT  process 
algorithm  at  the  application  level,  as  does  this  description.  The  MOOT 
process  is  centered  around  optimization  and  subsequent  formation  of  the 
NDSS,  although  at  the  practice  level,  a  MAUT  or  some  other  value  aggrega¬ 
tion  technique  is  needed  for  the  selection  of  an  optimum  form  of  the 
NDSS  for  the  actual  decision  step.  The  addition  of  a  formal  decision 
making  step,  which  is  usually  not  included  in  the  traditional  descrip¬ 
tions  of  MOOT  at  any  level,  is  required  in  order  to  select  the  optimal 
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policy  fro: r.  the  NDSS. 


3. 1  Description  of  the  Deterministic/Static  MOOT  Process 

The  following  is  a  description  of  a  aetemir.istic/static  MOOT  pro¬ 
cess  at  the  application  level.  Since  the  aeteministic/static  case  is 
a  general  fora  of  MOOT,  much  cf  this  description  is  also  applicable  to 
the  other  cases  of  MOOT.  While  the  cases  which  don't  consider  time  cr 
its  evolution  explicitly  are  generally  called  static,  these  cases  often 
consider  time  in  an  Implicit  and  wholistic  way.  That  is,  these  cases 
are  concerned  with  the  situation  at  a  terminal  time  and  not  necessarily 
on  the  situation  at  an  intermediate  time.  It  is  intended  that  this  pro¬ 
cess  description  will  bring  out  the  characteristics  needed  for  a  subse¬ 
quent  comparison  with  MATT.  Multiple  Objective  Optimisation  Tneory 
(MOOT)  applied  at  the  practice  level  uses  mathematical  optimisation  of 
multiple  criteria  to  facilitate  the  identification  cf  an  optimal  alter¬ 
native  action  as  a  solution  to  a  decision  situation.  MOOT  incorporates 
multiple  criteria  into  the  optimisation  step,  thereby  requiring  optimisa¬ 
tion  with  respect  to  this  vector  of  performance  objectives.  A  compre¬ 
hensive  pre-analysis  effort  to  determine  input  specification  is  the 
initial  phase  cf  the  '.-DOT  process.  The  MOOT  process  at  the  application 
level  includes  the  traditional  systems  analysis/modelling  and  mathemat¬ 
ical  optimisation  steps  of  impact  assessment,  and  the  policy  selection/ 
decision  making  step  of  output  specification. 

Tne  usual  techniques  utilised  in  the  Impact  assessment  of  the  MOOT 
process  are  from  the  area  of  mathematical  programming. 

The  'use  of  the  MOOT  process  for  a  practical  application  is  pre¬ 
dicated  on  the  following  assumptions: 

1 .  The  relationships  governing  the  system  described  by  the  deci¬ 
sion  situation  can  be  expressed  in  mathematical  equations. 

2.  The  attributes  used  to  measure  performance  of  the  alternative 
actions  should  be  established  as  preferentially  independent  'to  insure 
that  trade-offs  can  eventually  be  made  to  identify  the  optimal  policy , . 
This  PI  assumption  is  not  needed  to  determine  the  MOSS  but  is  generally 
needed  for  final  trade-off  analysis  and  alternative  selection. 

2A 


Traditionally,  the  relationship  among  the  objectives  has  not  been  con¬ 
sidered  in  MOOT .  Generally,  the  objectives  have  been  assumed  independent 
essentially  by  default. 

3.  The  DM  will  provide  preference  information  which  allows  the 
formation  of  a  scalar  choice  function  for  combining  the  objectives  and 
subsequent  selection  of  the  optimal  policy  from  a  MDSS. 

Output  Results  of  the  MOOT  Process 

Application  of  the  MOOT  process  generally  results  in  a  set  of  math¬ 
ematical  equations  which  describe  how  the  states  evolve  or  are  impacted 
by  alternative  acts  and  any  constraints  on  this  evolution.  From  a  speci¬ 
fied  vector  cost  function,  a  set  of  non-dominatec  solutions  which  re¬ 
sult  from  optimization  with  respect  to  the  vector  criteria,  a  quantifi¬ 
cation  of  preferences  of  the  DM,  an  identification  of  the  trade-offs 
present  in  the  situation,  an  identification  of  the  optimal  course  cf 
action,  and  an  indication  of  the  costs  and  benefits  of  implementing  the 
optimal  course  of  action  result.  Additionally,  as  a  by  product  of 
determining  the  optimal  policy,  information  is  usually  generated  which 
indicates  the  elements  to  which  the  solution  is  most  sensitive. 

MOOT  Process  Algorithm 

Several  steps  are  involved  in  the  application  of  MOOT,  and  these 
steps  are  accomplished  in  an  iterative  manner. 

a.  A  pre-analysis  phase  is  directed  toward  defining  the  scope  and 
boundary,  and  identifying  the  elements  of  the  decision  situation. 
Statements  of  the  objectives,  alternate  actions,  and  constraints  are 
developed  for  the  decision  situation.  The  input  specification  portion 
of  a  systems  effort  yields  this  information.  Preferential  independence 
should  be  established  among  the  attributes  to  insure  that  there  is  a 
quantitative  understandable  basis  for  trading-off  individual  units  cf 
the  attributes.  If  PI  among  attributes  cannot  be  established,  then 
analytic  trade-offs  are  either  not  possible  or  at  best  are  very  diffi¬ 
cult,  since  the  DM  views  all  attributes  as  interrelated  and  inter¬ 
dependent.  The  only  method  for  decision  making  in  this  case  is  appeal 
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to  the  DH's  intuition.  If  PI  is  established,  this  only  allows  pro¬ 
ceeding  with  the  multiple  criteria  approach.  Later  in  the  modelling 
step,  further  elicitation  concerning  the  attributes  is  required  such  as 
investigation  of  the  relationship  of  attributes  with  respect  to  weak 
difference  independence ,  mutual  difference  independence,  mutual  prefer¬ 
ential  independence,  etc.,  in  order  to  establish  the  form  (linear  addi¬ 
tive,  multiplicative,  etc.)  of  the  quantitative  value  function  (Dyer 
and  Sarin,  1979;  Keeney  and  Raiffa,  1976).  Additionally,  one  must  then 
evaluate  certain  levels  of  the  attributes  with  the  DM  in  order  to  estab¬ 
lish  the  scaling  parameters  in  the  value  function.  The  selection  of  an 
appropriate  level  to  approach  a  decision  situation  is  paramount  to  in¬ 
sure  a  tractable  problem  which  has  con textural  integrity. 

b.  A  systems  analysis /modelling  phase  is  used  for  the  construction 
of  a  precise  mathematical  model.  The  elements  which  'were  identified  in 
the  pre-analysis  phase  are  organized  into  a  set  of  equations  and  related 
mathematical  expressions  which  adequately  describe  the  decision  situa¬ 
tion.  The  objectives  and  goals  of  the  DM  are  included  in  the  model.  A 
set  of  value  functions  ( objective  or  cost  functions!  of  the  DM  are  used 
as  vector  criteria  to  judge  the  goodness  of  alternative  decisions, 

(e.g. ,  max  =  maximize  profit  (P),  and  min  =  minimize  time  spent 

( t ) )  and  a  set  of  alternative  actions  or  alternative  systems  each  com¬ 
posed  of  a  set  of  decision  variables  and  process  equations.  The  deci¬ 
sion  variables  represent  specific  activities  (e.g.,  allocation  of  two 
resources  in  amounts  and  ^ 1  whose  optimum  value  is  to  be  determined 
in  each  alternative  policy.  The  objective  functions  are  mathematical 
functions  of  the  state  and  occasionally  the  decision  variables.  These 
objective  functions  are  optimized  (maximized  or  minimized)  individually 
subject  to  a  set  of  restrictions  or  constraints  on  the  state  and  deci¬ 
sion  variables.  These  constraints  are  expressed  mathematically  as  in¬ 
equalities  or  equalities. 

c.  Optimization  of  the  objective  functions  is  accomplished ,  gen¬ 
erally  with  the  aid  of  a  digital  computer.  An  objective  function  is 
optimized  within  the  bounds  of  the  constraints  while  all  other  objective 
functions  are  held  at  or  near  some  prescribed  attainment  level.  The 
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other  objective  functions  become  in  effect  additional  constraints  (e.g. , 
max  J.j,  S.T.  wi'iere  is  set  at  various  values}.  While  a  set 

of  solutions  is  generated  from  optimization,  an  optimization  management 
routine  (Eeale  and  Cook,  1973)  utilizing  elimination  by  domination 
checks  each  solution  to  see  if  it  is  a  non-dominated  solution.  These 
non-dominated  forms  of  the  alternative  actions  represent  the  best  the 
various  alternative  actions  can  do  with  respect  to  the  vector  of  criteria. 

A  caveat  is  warranted  concerning  the  permanent  elimination  of  dom¬ 
inated  alternatives.  A  dominated  alternative  has  the  potential  of  being 
ranked  the  second  best.  This  is  of  particular  significance  if  it  is 
determined  later  that  the  optimal  policy  selected  from  the  NDSS  is  not 
implementable.  In  this  case,  one  must  avoid  identifying  the  next  best 
alternative  from  the  MOSS  as  the  new  optimal  without  first  checking  all 
feasible  alternatives  to  see  if  any  new  members  of  the  NDSS  are  produced. 

It  is  conceivable  that  a  previously  dominated  alternative  will  be  in  the 
NDSS  due  to  the  elimination  of  a  non-implementable  previous  optimal 
alternative.  It  is  generally  possible  to  identify  this  new  alternative 
as  optimal  through  the  use  of  a  scalar  scoring  function  (Appendix  3). 
Eliminating  alternatives  which  are  dominated  by  only  one  or  a  few  other 
alternatives  can  cause  only  the  best  and  the  worst  of  the  alternatives 
to  be  scored  with  a  scalar  choice  function  in  the  succeeding  policy- 
selection  step.  Transitivity  of  preferences  can  cause  this  comparison 
of  alternative  extremes.  The  dominance  relation  is  transitive  and  elimina¬ 
tion  of  dominated  alternatives  is  justified  because  of  this  transitivity. 
For  instance,  consider  transitive  multiattribute  alternatives  (a,b,c,  and 
d),  such  that  a  dominates  b  (a  )  b) ,  and  b  dominates  c  (b  }  c).  Trans¬ 
itivity  would  allow  us  to  eliminate  alternatives  b  and  c  thus  com¬ 
pare  only  the  a  and  d  with  a  scoring  function.  Depending  on  the 
scoring  function,  it  is  possible  for  either  b  or  c  to  have  a  larger 
score  than  d  and  in  that  case  we  would  not  be  considering  the  top  two 
choices,  but  the  first  and  last  choice.  Intuitively,  it  is  more  ap¬ 
pealing  to  trade-cff  the  top  ranked  alternatives  instead  of  the  top  and 
bottom  ranked  alternatives.  Therefore  it  is  recommended  that  an  alter¬ 
native  not  be  eliminated  only  on  the  basis  of  a  single  dominance  by 
another  alternative.  Instead  it  is  recommended  to  require  that  all  or 
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a  majority  of  alternatives  dominate  a  given  alternative  before  it  can 
be  safely  eliminated. 

When  a  group  of  DI-ls  are  involved  in  the  decision  situation,  the 
Pareto  criterion  may  be  a  very  important  tool  to  eliminate  the  inferior 
alternatives  since  interpersonal  comparison  of  preference  is  not  re¬ 
quired  to  form  the  DNSS. 

d.  Policy  selection  is  accomplished  when  the  DM  chooses  the  most 
preferred  solution  from  the  ND3S.  There  are  various  ways  to  do  this, 
such  as  using  an  indifference  function,  and  a  surrogate  worth  trade-offs 
(Haimes,  Hall,  and  Freedman,  1975).  All  of  these  structure  the  DH's 
preferences  and  ir.  effect  form  a  scalar  social  choice  function  .  SCF ) , 
composed  of  the  objective  functions  used  in  the  optimization  phase 
(e.g.,  J  =  f(Jv  J2)). 

In  the  general  case,  preference  information  is  elicited  from  the 
DM  (Dyer  and  Sarin,  1979)  in  order  to  generate  the  functional  form  as 
well  as  the  weights  (scaling  constants, wi)  of  the  SCF  (e.g.,  J  =  w^J]  + 
w2J2)*  0nce  the  SCF  is  constructed,  it  is  used  to  identify  the  single 
optimum  course  of  action  from  the  KDSS.  This  reduction  of  the  KDSS  is, 
in  effect,  a  post-optimization  ranking  exercise  which  often  requires  a 
digital  computer  utilizing  adaptive  search  procedures  '.Cohon  and  Marks, 
1975)  and  exhaustive  comparison  (Anyiwo  and  White,  1 976 ; . 

An  output  from  MOOT,  which  may  be  useful  to  the  analyst  in  pre¬ 
senting  the  alternatives  to  the  DM,  is  the  KDSS.  This  may  be  of  value 
in  the  general  case  and  is  of  particular  value  if  there  are  only  two 
objective  functions  because  a  graphical  display  of  the  KDSS  is  now  pos¬ 
sible. 

e.  Analysis  of  the  results  is  usually  conducted  to  evaluate  the 
robustness  of  the  solution  to  variation  in  parameters.  Critical  para¬ 
meters  are  identified,  the  sensitivity  of  the  solution  to  variations  in 
these  parameters  is  accomplished. 

f.  An  algorithm  for  the  MOOT  process  is  show;-,  in  the  DELTA  chart 
of  Figure  A.  The  policy  selected  in  the  decision  making  step  is  used  as 
the  input  into  the  planning  for  action  step.  The  steps  of  system 
analysis/modelling  optimization  and  decision  making  as  show.',  in  Figure  5 


3 

s 

•H 
p < 

a 

o 


i 


'>5A 

CD* 

•H 

P 

O 

& 


c 

o 


5  § 

O  3  P 
P  3  Cm 


M 


c 

°  WS 

C 

•H  »H 

o  jh: 
3  3 

o  s 


r-4 

cd 

cn 

3 

•H 

£  +* 

P  to 

»H 

a  3 

o 

c 

3  CO 

o 

acp  t* 

e  a 

w 

c  o  3 
•W  4^ 

P  Z  CtM 

p  a 

u 

tO  BP 

Cm  E  CO 

CO 

3  3  3 

o  o 

r-i 

O 

U  3 

3 

o 

a 


C  a> 
3  p 

u  ca 

0)  33 


T* 

i 


c 

O 

•  r^ 

p 

e  up 

Ci  c  3 

35m 

eu  «h  A> 

i  i 


aOP  p 

C  P  >J 
■hp  o  bl 
J*  C  p  c 
C  4)  P  P 

aa  o  # 

Ci  P  3<  3 


c 

o 

•H 

-p 

<a 

N 
U  P 
O  E 

+3  .P 

o  -p 
3  C. 

>  c 


M 

C 

•P  o 

ea  +5 

•  H 

sl 


p 

0) 

to 


33 

^  3  3  C 
P  CfjC  -P  O 
Q..H  P  3  P 

o  c  c-g 

x:  S  p  3 

3  o  u  £  p 

co  a>  o  o  o 

3  P  cp  33  03 
I 


\  CtC 

«  c 

CO  P  -P 

e  so  p 
3  >>p 

P  P  3 

co  3 's 
>5  C  o 
CO  <  £ 


Cl 

ctf 

O  35 

•r^ 

tp  3 

c 

C  fti 

3 

•P  P 

P  3 

3 

3  C 

Cm  3 

O  3 

CD  P 

c  t- 

c 

o 

•p  Ti 

P  c 

ca  ra 

3 
P 


C 

c 

p 

p 

ca 

p  o 
3  p 

p  .p 

3  3 

o  *99 

3m 

CO 


to 


to  ■ 


/V 


Q,  3 

o  e  u 

3  0  3 
•P  O  P 
«p 

o 

a 


c  a 
o 

.p  s 
C  3  P  O 
•P  3  3  3i 


c 

S3  O 
DO  P 
3  P 
3.  O 
P-  g 

X  3 


3 

to 

rf*4 

CD  3 
3  > 
M  *P 
ftp 
3 


p,  S  «w  W  *m 


si 

a  3 

p  e* 


S3 

c 

o 

•p 

p 

3 

3 

tr 

o 


p 

c 

0 

E 

to 

so 

CD 

CO 

CO 

<c 

p 

b 

3 

a 

s 


S3 
10  P 

3  C 
>  P 
•p  3 

P  Cm 
O  P 
3  W 
•p  C 
&  o 
o  o 


D  bkD  re 
>  C  co 
.p  PC  3 
P  St)  O  P 

3  c  3  p  -2 

r*  o  P  CO  3  3 
E  .P  O  P  P  P 

0)  P  C  3  3  2 

(J  «iH  O  M 

p  <S  w  -O  CO  > 

< 


I  I  I 


30 


Figure  5  «  MOOT  Formulation 


will  be  in  areas  of  concentration  in  the  subsequent  comparison  of  HOOT 
and  MAUI  processes. 

Appropriate  Conditions  for  Use  of  the  HOOT  Process 
The  application  of  the  MOOT  process  requires  a  set  of  necessary 
conditions  which  include  the  following: 

-  A  set  of  alternative  actions  and  criteria  to  judge  the  relative  good¬ 
ness  of  these  alternatives  quantitatively  must  exist  and  must  be  ex¬ 
pressible  in  mathematical  or  numerical  form. 

-  The  decision  situation  functional  laws,  constraints,  and  impacts  of 
pertinent  variables  must  be  expressible  in  mathematical  form. 

-  The  DM  must  provide  information  to  aid  in  structuring  the  situation 
and  establishing  performance  measures  and  preferential  independence 
between  them. 

-  The  DM  must  express  criterion  weights  associated  with  the  attributes 
in  order  to  form  a  SCF  when  this  is  needed  for  post-optimization 
policy  selection. 

MOOT  is  appropriate  for  selecting  the  best  alternative  policy  by 
mathematical  optimization  techniques  when  the  complexity  or  size  of  the 
decision  situation  makes  intuitive  solutions  extremely  difficult  to  ob¬ 
tain.  MOOT  can  be  used  for  situations  with  linear  and  non-linear  rela¬ 
tions  between  policy  and  state  variables.  MOOT  is  particularly  adept 
at  handling  physically  motivated  criteria  based  on  precise  mathematical 
relations  because  of  the  refinement  and  tuning  of  alternative  policies 
available  through  the  optimization  techniques.  In  practice,  MOOT  is 
utilized  to  select  the  best  of  a  set  of  proposed  policies  where  the 
decision  situation  is  composed  of  quantifiable  parts.  This  makes  MOOT 
particularly  valuable  in  hardware  oriented  decision  situations,  such 
as  in  determining  optimum  policy  parameters  in  subsystem  equipment  de¬ 
sign.  The  MOOT  approach  is  well  suited  for  application  to  public  and 
private  areas  typically  involving  resource  allocations. 

Input  Requirement  for  the  MOOT  Process 

Information  in  quantitative  form  needs  to  be  available  for 
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interrelating  the  salient  elements  of  the  decision  situation.  These 
elements  include:  a  set  of  stated  objectives  or  goals  which  are  prefer¬ 
entially  independent  and  by  which  the  relative  goodness  of  each  alter¬ 
native  solution  can  be  judged;  a  set  of  alternative  policies;  and  a  set 
of  any  restrictive  constraints.  These  elements  are  organized  into  a  set 
of  mathematical  equations  through  a  structuring  and  modelling  effort. 

Essential  personnel  required  for  the  HOOT  process  are  the  DMs 
responsible  for  the  decision  situations  and  an  analyst  familiar  with 
MOOT.  Generally  other  stakeholders  such  as  advisors  and  experts  are 
also  involved  to  some  degree  in  HOOT  in  the  modelling  effort. 

An  essential  facility  for  the  MOOT  process  is  a  digital  computer. 
Access  to  the  computer  with  rapid  computation  and  display  capability 
facilitates  management  and  presentation  of  data  for  the  stakeholders,  as 
well  as  optimization  in  the  multiobjective  realm.  Additionally,  graph¬ 
ical  display  materials  (e.g.,  video  CRT  and  CRT  projectors,  view-graph 
projector,  chalkboard,  etc.)  will  aid  in  interaction  between  the  analyst, 
DM,  and  stakeholders. 

A  set  of  questions  which  should  be  asked  at  the  conclusion  of  the 
HOOT  process  to  check  the  integrity  of  the  process  and  the  resulting 
optimal  policy  are  as  follows:  Does  the  mathematical  model  of  HOOT  sat¬ 
isfactorily  mimic  the  decision  situation  so  as  to  give  the  DM  confidence 
in  the  indicated  results?  Does  the  DM  understand  the  model  sufficiently 
to  give  he  or  she  confidence  in  the  results?  Are  the  results  consistent 
with  the  objectives  and  goals  of  the  DH  and  organization  responsible  for 
the  decision  situation?  Is  the  policy  produced  by  HOOT  ircplementable? 
Would  simple  intuitive  judgment  lead  to  as  good  a  solution  to  the  deci¬ 
sion  situation?  An  affirmative  answer  to  this  last  question  would  indi¬ 
cate  that  MOOT  is  not  needed  to  generate  a  solution  to  this  decision 
situation  in  the  future. 

Computer  programs  for  optimizing  the  individual  criteria  in  the 
optimization  process  are  available  on  most  large  computer  systems  ; e . g . , 
MP03,  CDC  optimization  pack,  etc.)  for  at  least  the  deterministic/static 
case.  The  optimization  management  programs  which  sequentially  accomplish 
(manage  the  routines  which  optimize  the  individual  criterion)  the 
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optimization  of  the  vector  of  criteria  and  subsequently  check  for  non- 
dominated  solutions  are  not  as  common.  Some  specific  examples  of  optimi¬ 
zation  management  programs  are  listed  by  Beale  and  Cook  (1975);  Tabak 
et  al.,  (1973);  and  Steuer  (1977). 

Various  applications  of  MOOT  have  been  accomplished,  such  as  an 
aircraft  control  systems  design  (Tabak,  et  al.,  1973),  the  composite  de¬ 
sign  of  a  Merchant  Marine  Fleet  (Everett,  et  al.,  1972),  a  simulation  of 
aircraft  performance  (Beale  and  Cook,  1975),  and  the  selection  of  an 
optimal  policy  for  water  resource  management  (Haimes,  1977). 

3.2  Modifications  To  The  MOOT  Process  Due  To  Probabilistic  And  Dynamic 
Considerations 

As  mentioned  in  the  theoretical  descriptions,  when  either  dynamic 
or  probabilistic  elements  are  included  in  the  MOOT  formulation,  the 
complexity  level  increases.  The  primary  steps  which  are  effected  are 
the  systems  modelling /analysis  and  optimization  steps.  One  must  take 
care  to  insure  that  the  model  formulation  of  the  multiple  objectives  anc 
constraints  accurately  incorporates  the  dynamic  flow  and  probabilistic 
elements  of  the  decision  situation.  This  generally  requires  the  use  of 
differential  equations  (difference  equations  in  the  discrete  time  repre¬ 
sentation)  to  represent  time  flows,  a  probability  transition  mechanism 
in  the  finite  state  representation,  and  the  use  of  the  expectation 
operator  to  tractably  work  with  the  probabilistic  elements.  The  optimi¬ 
zation  step  may  change  because  an  optimal  sequential  set  of  policies  or 
strategy  may  be  required.  This  optimal  strategy  may  occasionally  take 
on  the  form  of  a  randomized  strategy  (in  period  1,  implement  act  1  with 
•3  probability,  or  act  2  with  .7  probability),  but  because  of  the  diffi¬ 
culty  implementing  this  strategy,  the  DM  may  prefer  a  deterministic 
strategy. 

A.  An  Example  of  HOOT 

As  an  illustration  of  MOOT,  and  as  a  way  of  setting  up  a  basis  for 
comparison  of  the  conditions  required  for  optimization  in  the  MOOT 
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process  and  MAUT  process,  we  will  consider  an  example  from  the  area  of 
welfare  economics.  Welfare  economics  is  that  branch  of  economics  which 
deals  with  the  distribution  and  consumption  of  resources  for  the  public 
good  as  opposed  to  the  individual  good.  The  general  objective  of  welfare 
economic  analysis  is  the  evaluation  of  economic  alternatives  and  re¬ 
distribution  of  economic  resources  for  maximum  societal  benefits.  An 
allocation  of  resources  is  Pareto  optimal  when  no  other  reallocation  of 
production  and  distribution  will  increase  the  economic  satisfaction  of 
any  one  individual  without  decreasing  the  satisfaction  level  of  others 
in  society. 

Consider  the  following  formulation  of  society's  economic  problem. 

For  concreteness,  we  shall  assume  a  simple  closed  economy  with  two  con¬ 
sumers.  We  will  assume  that  the  economy  is  endowed  with  two  factors, 
capital  C  and  labor  L.  There  are  two  outputs  from  production,  a 
(clothing)  and  b  (food).  There  are  fixed  endowments  of  labor  and  capital 
C  and  L  described  by 

£  =  Ca  +  C.  '  2~ , 

a  b 

t  :  L,  +  L.  ,  25  ■ 

a  D 

where  C  and  L  are  the  maximum  levels  of  factor  suoplies,  C  and  C.  are 

a  D 

the  amount  of  capital  allocated  for  producing  a  and  b  respectively,  and 
L„  and  Lb  indicates  the  amount  of  labor  which  is  allocated  for  producing 
a  and  b  respectively.  The  production  functions  which  determine  the 
amount  of  clothing  and  food  produced  are  given  by 

a  r  f  (C  ,  L  )  29 

x  a  a 

b  —  f  j  ( i  . jj  * 

Two  alternative  actions  ,  A^) ,  which  are  each  composed  of  different 
production  functions,  have  been  defined.  Each  alternative  action  is 
composed  of  the  four  policy  variables  C  ,  Cfa,  L  ,  Lfa.  In  this  example, 
not  only  will  the  optimum  alternative  which  maximizes  the  utility  of  the 
two  consumers  be  identified,  but  also  the  best  levels  of  the  policy 
variables  for  the  optimum  will  be  found. 

We  assume  that  all  agricultural  and  clothing  production  will  be 
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distributed  between  the  two  consumers  as  needed  to  maximize  their  happi¬ 
ness.  Thus  we  have 


a  =  a.j  +  a2 

;3i 

b  r  b1  +  b2 

(32 

where  a^  and  a2  are  the  amount  of  clothes  allocated  to  consumers  1  and 
2  respectively,  and  b^  and  b2  are  the  amount  of  food  allocated  to  con¬ 
sumers  1  and  2  respectively.  The  objective  of  each  consumer  is  to  max¬ 
imize  his  or  her  utility. 

We  assume  that  the  utility  of  each  consumer  depends  directly  on  the 
quantity  of  products  consumed.  The  utility  functions  for  the  consumers 
are  assumed  to  be  the  isotone  functions 

u1  =  S1  ;ar  b1 )  '.33, 

u2  =  g2  ia2,  b2)  '34; 

The  vector  of  objectives  functions  is  defined  as 

Max  J  =  Max  [u^,  u2)  '35' 

Tne  optimization  step  commences  with  the  optimization  of  one  objective 
function  while  holding  the  value  of  the  other  objective  function  con¬ 
stant. 

Wow  we  can  pose  the  above  problem  as 


Max 

v 

,36: 

subject 

to  u2  =  U2 

3~ ; 

U  =  C  +  CK 
a  b 

;3c~ 

L  =  L_  +  L, 
a  b 

( 39 ' 

a  =  ^VCa’  La'  =  a1  +  a2 

(4C ; 

b  =  f j ( Cb ,  Lb)  =  b1  +  b2 

(4  V 

where  u2is  a  specific  level  of  utility  for  consumer  2.  Wow  adjoining 
the  constraints  to  with  Lagrange  multipliers,  optimizing  to  obtain 
the  necessary  conditions,  and  manipulating  those  conditions  to  elimi¬ 
nate  the  Lagrange  multipliers  yields  three  equations: 


3U„ 


83i 


ab 


1 


3U. 


3U. 


3  a. 


3'u, 

£ 

3  b, 


‘-■C 


1  J“1 

where  - —  and  —i —  indicates  the  marginal  utility  of  consumer  1  for  nro- 
3a1  3Di  3U2  3Up 

ducts  a  and  b  respectively,  and  ■=-=■  and  -rr—  indicate  the  marginal  utili- 

o  3^  o  t’2 

tv  fcr  consumer  2  for  products  a  and  b  respectively; 
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where  ~r  and  -»  are  the  marginal  oroducts  of  labor  and  caoital  resoec- 
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tively  in  industry  a,  and  —  and  ~  are  the  marginal  products  of  labor 
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•where  the  three  equations  represent  efficient  consumption,  production, 
and  product  mix  respectively.  The  optimization  problem  is  optimized 
many  times  for  various  values  of  Ieffecti\ely  this  is  allowing  the 
Lagrange  multiplier  to  change  values,.  Iterating  the  optimization 
procedure  with  each  alternative  for  various  values  of  u?  will  produce 
solutions  which  are  Pareto  optimal  for  each  alternative.  After  the  set  of 
feasible  optimal  solutions  has  been  generated,  a  digital  computer  sub¬ 
routine  can  be  used  tc  find  the  non-dominated  solution  set  ,  MDSS ! .  Me 
will  call  the  MDSS  the  set  Y  as  shown  in  Figure  6a.  In  the  policy 
selection  step,  the  preferences  of  the  DM  with  respect  to  the  attributes, 
are  used  to  construct  a  scalar  social  choice  function  (SCF', .  This 
SCF  (Y  =  f;u^,  i£  used  to  select  the  best  solution  from  among  the 
MDSS.  Assuming  that  difference  independence  (in  addition  to  preferen¬ 
tial  independence /  among  the  attributes  holds  (Dyer  and  Sarin,  1?^? ' , 
the  form  of  the  SCF  is 


36 


u2| 


[  r 

i  / 

i  Obtained.-  ^ 

!  from  alter>x>— Y 
native  1 

optimization  \  \s 

process  _ _ v  x 

Obtained  from-n 
|  alternative  2  opti- 
:  mization  orocess\ 


\ 


♦  1 


Figure  6a.  Non-Dominated  Solution  Set 
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Figure  6b.  Evaluation  Of  Non-Dominated  Solution 
Set  With  A  Social  Choice  Function 
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Y  =  a  •  u.j  + 


1  -  a  ] 


After  the  scaling  constant,  a,  has  beer,  assessed  ;Eyer  and  Sarin,  1579;, 

the  specific  solutions  in  Y  ■.iOSSj  are  ranked  by  Y  and  the  best  solu¬ 

tion  is  identified.  This  algorithm  will  score  each  member  of  the  h'DSS 
and  produce  a  set  of  Y  for  the  NDSS.  The  set  of  Y  is  illustrated  or. 

A  A*J; 

Figure  6b.  When  maximum  Y  =  Y  is  found,  this  solution  can  be  traced 

back  to  a  specific  action  A1  or  A£  (depending  on  whether  Y  came  from  the 

or  A?  optimisation  process,.  This  action  (A.,  or  A2 >  can  then  be  re¬ 
lated  to  the  ootir.um  levels  of  the  decision  variables  C  ,  C.  ,  L_ ,  and 
~  a  c  c. 

L  .  The  sought-after  solution  includes  the  identification  of  the  ODtirntr. 
b  . 

distribution  of  commodities  a^,  a^,  b^,  and  bp  which  would  result  from 
the  optimal  policy.  Iteration  of  the  MOOT  procedure  along  with  a  com¬ 
prehensive  sensitivity  analysis  gives  the  DX  air  idea  of  the  robustness 
of  the  optimal  policy.  An  action  plan  for  implementation  of  the  optimal 
policy  would  normally  follow. 

A  numerical  realization  of  the  previous  example  will  be  presented 
before  extending  the  example  to  the  case  of  multiple  DMs .  Assume  that  a 
pre-analysis  phase  has  established  that  the  form  of  the  objective  func¬ 
tions  for  the  two  consumers  is 

u,  =  a,  +  b«  .Ac  1 

I  i  i 

u^  =  (a^b^)'’’  ,  A”) 

and  two  alternative  production  systems  are  defined  as  follows: 

Action  A.j  (use  production  system  1) 

a  =  f1!Ca'La}  =  (CaLa''5  4£' 

b  --  f2(Cb,Lb)  =  (CbLb)*5  -A9' 


Action  A2  (use  production  system  2) 

a  =  f,(C„  ,LJ  =  C  -  1.  (5CJ 

3  a  a  a 

b  =  f4(Cb,Lb;  =  (Lb)*5  -  2.  (5D 

In  this  simplified  example,  we  assume  there  is  no  risk  or  uncertainty. 

In  sequence,  the  equations  from  each  alternative  production  system  along 
with  the  objective  functions  are  substituted  into  equations  36,  37,  AO, 
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and  41  and  the  optimization  process  is  carried  out.  each  value 

function  is  optimized  for  both  alternative  systems.  The  solutions  for 
the  proposed  alternative  systems  1  and  2  and  the  resulting  h'DSS  are  shown 
on  Figure  7.  Assume  that  the  attributes  are  preference  independent,  and 
that  the  SCF  has  been  determined  to  be 

Y*  =  vu.^  (52; 

where  v  is  a  constant  determining  a  family  of  isopreference  curves. 

This  SCF  is  tangent  to  the  ND3S  at  v  =  0.05  at  point  T  in  Figure 
Point  T  is  then  the  optimum  policy  of  implementing  production  system 
1 (A- )  with  5.0  units  of  capital  (C  )  and  5.0  units  of  labor  v  L_ }  gcinc 

1  3  ^  a  w  ~ 

into  production  of  clothing  and  5.0  units  of  capital  vCK)  and  5.0  units 
of  labor  (C^)  going  into  production  of  food.  This  policy  will  produce 
the  allocation  of  2.5  units  of  clothes  (A^)  and  2.5  units  of  food 
to  consumer  1  (u1  =  5),  and  2.5  units  of  clothes  (a^)  and  2.5  units  of  food 
(b2)  to  consumer  2  (u2  =  2.51.  Pending  a  sensitivity  analysis,  the  optimal 
policy  has  been  identified  for  the  case  of  a  single  DM. 

The  situation  of  multiple  DM  occurs  frequently  especially  in  the 
public  sector.  To  extend  this  MOOT  ex-ample  to  the  case  of  multiple  DMs, 
two  DMs  will  be  assumed  to  each  have  different  attribute  preferences. 

The  objectives  of  both  DMs  are  presumed  identical,  and  the  set  of  system 
equations  are  presumed  valid.  The  optimization  and  subsequent  produc¬ 
tion  of  the  NDSS  are  carried  out  as  before.  The  difficulty  now  arises 
as  to  how  tc  combine  the  individual  DM’s  preferences  over  the  attributes 
into  a  SCF.  Authors  have  approached  this  problem  of  inter-attribute 
comparison  in  a  variety  of  ways  (Bankers  and  Gupta,  1976;  Kirkwood,  1?72; 
Eliashberg,  1973;  Nakayama,  1979;  Sage,  1977)  because  of  the  revelations 
of  Arrow’s  impossibility  theorem  (Arrow,  1963).  The  most  popular  method 
is  a  linear  weighting  of  the  preferences.  Since  there  are  two  DMs,  a 
majority  voting  scheme  can  be  used  to  establish  the  consensus  weights. 
Assume  that  the  first  DM  has  the  SCF  of  equation  52  and  that  the  second 
DM  has  the  SCF  of  equation  45  with  a  =  .3  .  Vie  assume  that  the  DM’s 
preferences  are  each  weighted  equally  (i.e.,  fifty  percent  for  each  . 

7ne  resulting  combined  SCF  is 

Y* =  .5(0cu^u2)  +  .5' .3u]  +  . ?u2 ,  ,52' 
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Figure  7.  Results  Of  Welfare  Optimization 


Now  the  NDSS  shown  in  Figure  7  is  ranked  -with  respect  to  this  scalar 

SCF  to  produce  the  maximum  score  of  Y’  =  2.13  for  alternative  Ay  Now 

A-  is  still  implemented  with  activities  of  £  =  5.0,  C.  =  5.0,  "£  =5.0 

i  r  aba 

and  =  5.0  but  the  resulting  distribution  changes  to  §,  =  2.19, 

§2  =  2.31,  =  2.19,  and  =  2. 81  (u ^  =  A. 33,  =  2.31).  This  change  i 

distribution  levels  was  caused  by  DM  #2  increased  preference  for  the 
utility  of  consumer  2. 

A  sensitivity  analysis  would  give  feedback  as  to  the  validity  of 
this  consensus  opinion  before  implementation  is  actually  planned.  Ir. 
this  sensitivity  analysis  we  would  include  an  investigation  of  the  impact 
on  optimal  policy  identification  that  the  variation  in  scaling  parameter 
values  cause. 

5.  Summary 

In  this  chapter,  multiple  objective  optimization  theory  (MOOT)  was 
presented  as  a  technique  which  may  be  employed  to  resolve  a  decision 
situation.  MOOT  was  first  presented  at  the  theoretical  level  for  four 
cases  of  a  decision  situation  (deterministic/static,  probabilistic/ 
static,  deterministic/dynamic,  and  probabilistic/dynamic;.  It  was  noted 
that  while  Pareto  optimality  has  the  advantage  of  net  requiring  inter¬ 
personal  comparison  of  preference  in  a  group  of  DMs,  it  has  a  disadvantage 
in  that  it  is  not  a  complete  choice  rule  (allowing  identification  of  a 
single  optimal  policy)  since  there  may  be  many  Pareto  optimal  alterna¬ 
tives.  Then  a  process  algorithm  for  MOOT  was  presented  at  the  practi¬ 
cal  application  level  in  the  systems  engineering  format.  At  the  prac¬ 
tice  level,  it  was  shown  that  the  MOOT  process  requires  a  MAUI  technique 
to  accomplish  the  decision  making  step.  An  example  is  presented  of  MOOT 
at  the  application  level  using  a  welfare  economics  setting.  The  example 
illustrates  the  formation  of  a  NDSS  and  subsequent  selection  of  the 
optimal  policy  from  this  incomplete  ordering. 
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CHAPTER  3 


MULTIPLE  ATTRIBUTE  UTILITY  APPROACH  TO  DECISION  SITUATIONS 

1 .  Introduction 

A  multicriterion  decision  theory  (MCDT)  approach  of  interest  to  the 
practitioners  and  theoreticians  seeking  to  resolve  decision  situations 
represented  by  complex  alternative  acts  with  many  attributes  is  multiple 
attribute  utility  theory  (MAUT) .  This  effort  presents  MAUT  at  both 
the  theoretical  and  application  level.  The  MAUT  process  is  applied  to 
a  welfare  economics  decision  situation  to  illustrate  the  MAUT  process. 

2 •  Description  Of  MAUT  At  The  Theoretical  Level 

MAUT  is  basically  a  decision  making  theory  which  requires  the 
analyst  to  elicit  preference  information  concerning  the  attributes  of 
proposed  alternative  policies  from  the  decision  maker  (DM).  Utilizing 
the  DM's  preferences,  the  analyst  forms  a  scalar  choice  function.  Each 
alternative  has  associated  with  it  a  set  of  events  and  outcomes.  The 
event  outcomes  may  occur  with  either  certainty  or  uncertainty.  The 
scalar  choice  function  is  used  in  conjunction  with  the  corresponding 
outcomes  of  each  alternative  to  score  and  subsequently  rank  alternative 
policies  for  the  decision  making  step. 

2. 1  MAUT  -  Certain  Outcomes/Time  Invariant  Case 

This  MAUT  problem  can  be  represented  mathematically  as 


maximize  u[h(x,a)] 

=  q ( h i , h^ , , , hp ) 

(1) 

subject  to:  fix, a) 

r  0  ■ 

(2) 

g(x,a) 

<  0 

(3) 

where  a  is  the  vector  of  decision  variables,  x  is  a  vector  of  outcome 
states,  u  is  a  scalar  value  function  of  the  DM  (cardinal,  or  ordinal 
utility/value  function)  and  q  is  a  function  of  the  attributes  (e.g. , 
an  aggregation  of  attributes  or  of  the  utility  of  the  attributes)  f 
and  g  include  the  linking  of  policies,  events,  and  outcomes,  and  other 
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constraints.  Each  policy  is  evaluated  and  subsequently  ranked  (this 
amounts  to  an  exhaustive  evaluation  over  all  alternative  policies) 
according  to  the  scalar  social  choice  function  (SCF)  scoring  form,  u. 
This  SCF  is  an  amalgamated  utility  function  which  is  obtained  by  elic¬ 
iting  the  DK's  preferences  over  the  attributes  (weighing  the  attributes 
relative  to  each  other). 

The  resulting  conditions  for  optimization  (identification  of 
the  optimal  policy) are: 

f(x,a)  =  0  (A) 

glx,a)  <  0  (5) 


3  u  3hn  3g(x,a)  3f(x,a) 

3h“  "al  6  £!  y  ~  0 

eT  (g(x,a) )  =  0 

yT  (f(x,a) )  =  0 


(6) 

(7) 

(6) 


e,Y  >  0 


where  a  is  the  optimal  policy  and  x  is  the  set  of  optimal  outcome  states, 
y  is  a  Lagrange  multiplier  vector  for  the  f(x,a!  =  0  set  of  constraints 
and  e  is  the  Lagrange  multiplier  vector  for  the  g(x,a)  <_  0  set  of  con¬ 
straints.  In  order  to  use  the  above  formulation,  a  decision  situation 
must  have  all  outcomes  occurring  at  the  same  time,  and  each  outcome 
associated  with  each  alternative  known  with  certainty.  While  a  linear 
SCF  is  often  assumed  in  the  case  with  certainty  of  event  outcomes, 
other  forms  are  also  possible  such  as  multiplicative  or  multilinear. 

Well  documented  assessment  procedures  can  be  used  to  establish  the  form 
of  the  scalar  SCF,  to  form  constituent  worth  curves,  and  to  evaluate 
the  scaling  constants  of  the  SCF  (Keeney  and  Raiffa,  1976;  Dyer  and 
Sarin,  1979;  Miller,  1967;  Edwards,  1977). 


2.2  MAUT  -  Uncertain  Outcomes/Tirae  Invariant  Case 


MAUT  is  widely  used  in  situations  which  involve  event  outcome  un¬ 
certainty  .  These  events  have  associated  with  them  outcome  state  proba¬ 
bilities  formed  from  either  empirical  data,  or  subjective  data  obtained 


from  the  DM  in  an  elicitation  process.  We  now  wish  to  find  the  alter¬ 
native  which  maximizes  the  expected  utility  of  the  DM.  For  the  discrete 
cases,  this  is  given  by 

maximize  E(u)  =  maximize  \  (ai )u ( z^ j ta^ ) )  110) 

over  each  alternative  a.  where  E  is  the  expectation  operator,  p.  is 

th  o 

the  probability  of  the  j  event  outcome,  z ij.  The  scalar  SCF,  u,  is  a 

utility  function  which  incorporates  the  Din  attitude  toward  risk.  This 
function  can  be  formed  by  combining  the  attributes  into  a  single  attri¬ 
bute  and  then  transforming  it  to  a  risky  utility  function  (Boyd,  1970;, 
or  by  forming  constituent  utility  functions  for  the  attributes  and  then 
aggregating  these  into  a  scalar  function.  Many  authors  including 
Keeney  and  Raiffa  11976)  describe  assessment  procedures  for  this  latter 
method  which  enable  one  to  discern  the  form  of  u  and  to  identify  scaling 
parameters  based  on  the  relationships  among  the  attributes. 

The  alternative  policies,  events,  outcomes  and  uncertainty  in  a 
MAUT  formulation  can  usually  be  displayed  in  a  decision  tree  format 
such  as  the  simplified  single  stage  tree  shown  in  Figure  1 .  In  a 
special  case  of  the  single  stage  decision  problem,  which  includes 
probabilistic  elements,  if  the  event  outcomes  are  the  same  for  each  alter¬ 
native  policy,  then  it  may  be  possible  to  identify  the  optimal  policy 
without  determining  the  utility  for  the  outcomes  assuming  the  outcomes 
can  be  ordered  on  a  monotone  scale)  by  employing  the  concept  of  stochas¬ 
tic  domination  (Bunn,  1973). 

2.3  MAUT  -  Time  Varying  Case 

In  Sections  2.1  and  2.2,  time  was  included  in  the  concept  of  an 
outcome  state  which  contained  a  summary  of  many  circumstances  of  which 
terminal  time  was  at  least  implicitly  considered.  For  example,  an 
event  outcome  may  be  to  realize  a  favorable  reward  from  a  business 
endeavor.  This  outcome  does  not  specify  a  specific  time  dependency, 
instead  it  is  meant  that  at  a  terminal  time  in  the  future,  the  favorable 
business  reward  will  be  realized.  Hence,  utility  assessment  is  conducted 
without  explicitly  bringing  in  a  time  dependency.  A  difficulty  in 


incorporating  time  into  MAUT  concerns  the  assessment  of  utility  under 
time  varying  conditions.  The  concept  of  assessing  the  DK's  utility  as  a 
function  of  his  or  her  value  for  an  attribute  and  on  the  passage  of  time 
makes  for  a  very  difficult  assessment.  Other  problems  can  occur  in  the 
evaluation  of  E  [u(x)]  if  x  evolves  from  a  time  dependent  process.  For 
example,  in  the  time  dependent  case,  equation  (2)  becomes 

dx  =  f(x,a,t)  dt  +  0  (t)  dw  (11) 

where  dw  is  the  realization  of  a  random  process  (for  example  a  Weiner 
process).  While  x(t)  and  its  moments  can  be  determined,  there  are 
problems  evaluating 

E[u(x)]  =  |  u(x)  p(x)  dx  (12; 

where  x  evolves  from  (11)  unless  u(x)  is  linear  or  quadratic. 

If  all  outcomes  occur  at  specific  points  in  time,  it  is  reasonable 
to  discount  the  utility  or  expected  utility  over  time  as  a  way  of 
bringing  in  a  sense  of  dynamics.  This  discount  factor  incorporates  the 
concept  that  immediate  effects  are  of  more  value  than  future  events. 

For  the  risky  case  of  MAUT,  the  SCF  becomes 

L  k  1 

E(u)  =  (  l  [a  '  l  p.(a,)u(z.  . (a. ) )] .  (13) 

k=1  j  J  J 

where  a  is  the  discount  factor  and  L  the  number  of  periods. 

A  tractable  technique  which  is  occasionally  used  is  the  practice 
of  costing  out  the  attributes  and  combining  their  value  into  a  pecuniary 
sum  which  can  be  used  in  a  discounted  time  stream.  Here  time  is  in¬ 
cluded  explicitly  along  with  a  discount  rate.  The  social  choice  func¬ 
tion  now  can  take  the  form  of 

L  i-i 

C  =  l  a  1  1  C,  ( 1 A ) 

i=1  1 

where  C  is  the  present  net  worth  of  the  income  stream,  is  the  income 
for  the  i  period,  i= 1 ,,,,,, L ,  which  is  a  result  of  costing  out  the 
attributes  for  the  outcome  of  that  period.  The  alternative  with  the 
highest  value  of  present  net  worth  is  the  preferred  alternative. 
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3.  Multiple  Attribute  Utility  Process 


Multiple  Attribute  Utility  Theory  (MAUT)  applied  at  the  practice 
level  describes  techniques  which  determine  the  DM's  utility  and  select 
the  optimal  course  of  action  as  a  solution  to  a  decision  situation. 
Multiple  Attribute  Utility  Theory  is  currently  the  object  of  considera¬ 
ble  research  and  application,  and  it  is  likely  that  there  are  differ¬ 
ences  of  opinion  among  practitioners  and  researchers  on  the  scope  and 
nature  of  this  approach  as  used  in  practice.  While  it  is  basically  an 
algorithm  for  decision  making,  some  practitioners  of  multiple  attribute 
utility  theory  include  all  systems  engineering  steps  within  the  algor¬ 
ithm,  as  does  this  description. 

3. 1  Description  Of  The  MAUT  Process  With  Uncertain  Outcomes 

A  MAUT  process  involving  uncertain  outcomes  is  now  described.  The 
use  of  MAUT  is  predicated  on  the  following  assumptions: 

1 .  Feasible  sets  of  alternative  actions  and  the  events  and  event 
outcomes  resulting  from  the  alternative  acts  can  be  identified. 

2.  The  cause-effect  relationships  between  alternative  actions 
and  the  outcomes  can  be  determined  so  that  the  decision  situation  model 
mimics  reality  adequately. 

3.  A  set  of  attributes  must  be  defined  which  measure  the  attain¬ 
ment  of  the  objectives  of  the  decision  situation.  The  DM  will  provide 
preference  information  over  this  set  of  attributes  (which  also  describe 
the  characteristics  of  the  outcomes)  in  a  form  which  will  allow  his  or 
her  felicity  for  each  outcome  to  be  expressed  in  a  scalar  utility  score. 

4.  Probabilistic  information  concerning  the  outcomes  is  available 
from  empirical  data,  or  it  can  be  obtained  with  a  subjective  assessment 
from  appropriate  personnel. 

Output  Results  of  the  MAUT  Process 

Successful  application  of  the  MAUT  process  should  result  in  a 
realistic  model  of  the  decision  situation  (often  in  graphical  form)  in 
terms  of  action  alternatives  and  outcomes.  The  output  from  a  MAUT 
process  should  include  a  quantification  of  the  DM's  preferences  with 


respect  to  the  event  outputs,  an  identification  of  trade-offs  present 
in  the  decision  situation,  an  identification  of  the  optimal  decision 
policy,  a  determination  of  the  costs  and  benefits  of  the  optimum 
strategy,  and  an  indication  of  the  robustness  of  the  solution. 

MAUT  Process  Algorithm 


The  application  of  MAUT  involves  many  steps  which  should  be  accom¬ 
plished  in  an  iterative  manner. 

a.  A  pre-analysis  phase  defines  the  scope  and  boundary,  and 
identifies  the  elements  of  the  decision  situation.  These  elements  in¬ 
clude  the  needs,  constraints,  alterables,  objectives  or  goals,  and 
attributes  (e.g.,  let  attribute  h^  represent  cost,  and  h^  represent 
performance).  A  set  of  decisions  or  alternative  policies, (e.g.,  let  a1 
represent  a  decision  to  buy  commodity  1  and  3p  the  decision  to  purchase 
commodity  2)  which  can  resolve  the  decision  situation, is  identified. 

b.  A  systems  analysis/modelling  phase  accomplishes  the  struc¬ 
turing  necessary  to  define  a  finite  set  of  possible  and  reasonable 
events  and  associated  event  outcomes  for  the  decision  situation.  These 
event  outcomes  are  described  in  terms  of  the  attributes  (e.g.,  let  a 
set  of  outcomes  be  z i  where  z ^  =  (h^1,  h^1)}  so  that  their  merit  can  be 
related  back  to  achieving  the  objectives  of  the  decision  situation. 

The  modelling  continues  by  identification  of  the  relationships  between 
the  decisions  and  the  event  outcomes.  The  alternative  policies  nay 
require  refinement  and  tuning  which  is  efficiently  accomplished  using 

a  mathematical  optimization  technique.  The  original  alternative  poli¬ 
cies  or  a  selected  number  of  the  refined  forms  of  the  alternative  poli¬ 
cies  become  the  actual  decision  options  which  are  linked  to  the  outcome 
states  through  established  relationships.  Since  these  relationships 
are  governed  by  risk,  the  causal  relationship  of  the  decision,  event, 
and  subsequent  event  outcome  can  be  represented  efficiently  in  a  deci¬ 
sion  tree.  Since  outcome  uncertainty  is  present,  encoding  of  subjective 
probability  from  experts  or  the  DM  is  a  viable  approach  to  identifying 
and  quantifying  the  uncertainty. 

Since  the  outcomes  are  combinations  of  events  and  decisions,  the 
DM's  value  (e.g.,  v  (z^^la^))  where  v  is  the  value  of  outcome  zi-  caused 


by  decision  a^)  of  an  outcome  (function  of  attributes)  can  be  used  to 
comparatively  score  the  alternative  action  that  caused  the  outcome. 

Once  the  decision  situation  is  modelled  in  MAUT,  a  preference  assessment 
effort  is  conducted.  The  purpose  of  the  preference  assessment  is  to 
elicit  information  required  to  construct  the  DM's  preference  function 
for  the  various  attributes  which  describe  the  possible  outcomes  (Keeney 
and  Raiffa,  1976).  Since  we  are  assuming  uncertainty  over  outcomes,  this 
preference  function  is  in  the  form  of  a  cardinal  utility  function  which 
incorporates  the  DM's  attitude  toward  risk.  This  preference  function 
is  in  effect  a  scalar  social  choice  function  (SCF).  The  SC?  can  be 
formed  in  two  ways  (Keeney  and  Raiffa,  1976); 

1 .  Assigning  a  scalar  utility  score  to  a  scalar  value  function: 

This  function  has  incorporated  the  DM's  value  of  the  outcome  in  an 

acceptable  form.  This  value  function  is  generally  a  scalar,  v  = 

f(v, ,,v, ,,v  )  where  v.  is  a  value  function  of  the  ith  attribute.  An 
1  l’  n  l 

assessment  of  a  scalar  utility  function  is  all  that  is  then  required  to 
transform  the  value  function  score  to  a  utility  function  score  (e.g., 
the  utility  SCF  is  u  =  f (viz^lz^ ) ) .  This  wholistic  approach  is  sug¬ 
gested  by  many  such  as  Boyd  H970/.  This  approach  may  be  aided  by 
deterministic  aids  such  as  SMART  (Edwards,  1977)  or  policy  capture 
( Hammand ,  et .  al . ,  1 977 ) . 

2.  Establishing  relationships  between  the  attributes  directly  with 

respect  to  preference  and  utility  independence.  These  relationships 
dictate  the  functional  form  of  the  SCF  of  utility.  Once  this  form  is 
established,  the  utilities  for  the  attributes  are  assessed  and  scaling 
constants  (weights)  are  evaluated  to  define  the  SCF  (e.g.,  the  utility 
SCF  is  u  =  f[u^  ix.j ) , u^ ( X2 ) ] *  Wow  the  outcomes,  in  terms  of  their 

attribute  levels,  are  transformed  to  a  scalar  utility  score.  When  a 
group  has  responsibility  for  the  decision,  this  preference  elicitation 
process  becomes  more  complex.  Various  authors  have  addressed  the  prob¬ 
lem  of  group  consensus  to  form  a  SCF  (Arrow,  1963;  Keeney,  1976a; 
Harsanyi,  1955;  Keeney  and  Kirkwood,  1975;  and  Wakayama,  et  al.,  1979). 

After  all  the  outcome  values  or  characteristics  have  been  replaced 
•with  the  DM's  utility  for  those  outcomes,  the  decision  model  is  ready 
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to  be  optimized  (e.g.,  is  replaced  by  u  [z^) . 

c .  Ranking  of  the  alternative  actions/policy  selection  basically 

involves  maximizing  the  DM’s  utility  over  the  set  of  decisions.  This 

subjective  utility  aggregation  involves  averaging  out  utility  scores 

for  each  decision,  and  folding  back  the  decision  model  if  it  is  a 

staged  or  sequential  model  involving  probabilistic  concepts  (e.g.,  max 

E(u)  =  max  J[p.(a. )  •  u(z.  .(a. ))1.  Since  the  criterion  is  the  expected 
a  z  J  1  1  “ 

value  of  a  scalar  SCF,  an  ordered  ranking  of  alternative  actions  is  ar. 
available  result. 

d.  Sensitivity  Analysis  is  conducted  to  investigate  modelling 
errors.  This  exercise  can  contain  ar.  analysis  of  the  value  of  gather¬ 
ing  more  information  to  refine  the  accuracy  of  likelihood  estimates. 

e.  An  algorithm  for  the  MAUT  process  is  shown  in  the  DELTA  chart 
of  Figure  2.  The  policy  selected  in  the  decision  making  step  is  used 
as  the  input  to  the  planning  for  the  action  step.  The  specific  activ¬ 
ities  in  the  modelling,  ranking  of  alternatives/decision  making  steps 
are  shown  in  Figure  3. 

MAUT  is  appropriate  for  identifying  the  optimal  course  cf  action 
using  utility  theory  techniques  when  the  size  or  complexity  of  the 
decision  situation  makes  intuitive  solutions  extremely  difficult  to 
obtain.  MAUT  is  adept  at  handling  situations  with  static  or  sequential 
•settings  concerned  with  risk,  uncertainty,  or  deterministic  data,  and 
the  DM's  attitude  toward  any  risk.  Many  MAUT  techniques  are  particularly 
adept  at  handling  behavioral  motivated  criteria  because  of  their  ability 
to  model  subjective  quantities  as  well  as  incorporate  qualitative  infor¬ 
mation.  The  MAUT  approach  is  well  suited  for  application  to  many  public 
and  private  decision  areas  such  as  evaluating  risky  ventures,  and 
identification  of  preferred  courses  of  action. 

Input  Requirements  for  the  MAUT  Process 

Information  in  usable  form  needs  to  be  available  for  inter¬ 
relating  the  salient  elements  of  the  decision  situation.  This  informa¬ 
tion  includes:  a  set  of  attributes  which  measure  the  attainment  of  the 
objectives  and  goals;  a  set  of  feasible  decisions  as  proposed  solutions 
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Figure  3  .  MAUT  Formulation 


to  the  decision  situation;  set  of  outcomes  (described  in  terns  of  the 
attributes)  as  possible  results  of  the  decisions;  the  relationships 
between  the  alternative  actions  and  the  outputs;  valuation  of  the  out¬ 
comes  using  the  preferences  of  the  DM  over  the  attributes  and  outcomes, 
and  possibly  the  DM's  attitude  toward  risk. 

Essential  personnel  required  for  the  MAUT  process  are  the  analyst  is 
experienced  with  MAUT  techniques,  and  the  DM(s)  who  are  responsible  for 
a  solution  to  the  decision  situation.  Generally  other  stakeholders 
and  experts  are  also  involved  in  the  MAUT  process  in  order  to  aid  in 
the  modelling  effort. 

Recommended  facilities  for  use  in  a  MAUT  process  are  graphical 
display  devices  (CRT,  CRT  projector,  view-graph  projector,  chalkboard, 
charts,  etc.)  and  a  digital  computer  to  aid  in  interrelating  elements, 
encoding  probabilities,  eliciting  preferences,  ranking  the  alternatives 
and  displaying  results.  These  aids  process  and  present  information 
visually  which  will  often  facilitate  the  interaction  between  the 
analyst  and  stakeholders. 

The  integrity  of  the  MAUT  process  and  identified  optimal  policy 
can  be  checked  by  the  following  set  of  questions:  Does  the  decision 
model  of  MAUT  adequately  mimic  the  reality  of  the  decision  situation  sc 
as  to  give  the  DM  confidence  in  the  indicated  results?  Are  the  results 
consistent  with  the  objectives  and  goals  of  the  DM  and  organisation 
responsible  for  the  decision  situation?  Does  the  DM  understand  the 
model  sufficiently  to  give  confidence  in  the  results?  Have  trade-offs 
required  in  the  resolution  of  the  decision  situation  been  identified? 

Are  the  results  of  MAUT  in  a  form  which  can  be  implemented  by  the  DM? 
Could  intuitive  judgment  have  been  used  to  produce  a  solution  of  com¬ 
parable  quality? 

Additional  Information 

There  are  many  computer  programs  available  to  aid  the  analyst  in  a 
MAUT  application.  The  greatest  number  of  programs  to  aid  in  preference 
elicitation  and  subsequent  optimisation  of  the  decision  model  have  been 
associated  with  the  technique  of  decision  analysis  . e.g.,  CTREE,  MUECAF, 
PEP,  MAUECOU)  as  discussed  by  Schlaifer  (197D,  Keeney  and  Sicherman 
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(1975).  There  are  also  programs  designed  to  aid  in  utility  assessment 
as  discussed  by  Freedy  et  al.,  (1974;  and  Ulvila  (1975). 

MAUT  has  been  applied  to  applications  such  as  the  selection  of 
development  strategies  for  airport  facilities  for  Mexico  City  (Keeney 
and  Raiffa,  1976),  the  identification  of  policy  for  land-use  regula¬ 
tion  in  California  (Edwards,  1977),  the  evaluation  of  emergency  commu¬ 
nications  systems  (Yorke,  C-ianniny,  and  Sage,  1973),  the  selection  of 
optimal  policy  for  a  metal  broker  to  follow  in  purchasing  iron  ore 
(Brown,  Kahr,  and  Peterson,  1974),  the  selection  of  an  optimal  policy 
for  location  of  a  house  for  the  family  to  reside  in  (Nakayama,  et  al., 
1979),  and  the  selection  of  policy  for  water  resource  planning  (Keeney 
and  Wood,  1977 ) . 

3.2  Variations  In  The  MAUT  Process  With  Certainty  Of  Outcomes 

The  major  difference  in  the  probabilistic  and  deterministic  MAUT 
processes  concerns  the  uncertainty  of  outcomes.  The  deterministic  case 
assumes  that  the  outcomes  from  the  different  alternative  policies  are 
known  with  certainty.  This  makes  it  unnecessary  to  incorporate  the 
DM's  attitude  toward  risk  or  to  assess  subjective  probabilities  for  the 
events.  Value  or  worth  scores  for  the  attributes  can  be  assessed,  and 
the  form  of  the  SCF  can  be  found  from  the  relationship  of  the  attributes. 
Often,  a  linear  form  of  SCF  is  used  (the  attributes  are  assumed  inde¬ 
pendent)  in  the  case  of  certain  outcomes  (Miller,  1967;  Edwards,  1977). 
There  is  now  no  need  for  an  expectation  operator  as  each  alternative  is 
scored  by  the  deterministic  SCF.  This  scoring  allows  a  ranking  of 
alternatives  and  subsequent  decision  making  step. 

4 .  An  Example  of  MAUT 

To  illustrate  the  MAUT  process,  and  as  a  way  of  producing  a  basis 
for  comparison  of  the  conditions  required  for  optimization  in  the  MAUT 
process  and  MOOT  process,  we  will  consider  the  same  example  from  the 
area  of  welfare  economics  as  presented  in  the  previous  chapter.  MAUT 
is  a  valuable  technique  because  it  can  be  utilized  to  resolve  the  inde¬ 
terminancy  which  arises  if  Pareto  optimality  is  a  requirement  for 
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welfare  optimization.  We  assume  that  society  is  concerned  with  equity 
(all  members  receiving  the  same  level  of  satisfaction  with  the  conse¬ 
quences)  as  well  as  efficiency  (Pareto  optimality).  We  further  assume 
that  a  benevalent  DM  will  combine  the  utilities  of  its  members  into  a 
scalar  function  which  reflects  the  aggregate  utility  of  society.  One  can 
generally  find  a  scalar  objective  function  which  has  been  maximized  for 
any  particular  optimal  resource  allocation.  In  welfare  economics,  this 
scalar  social  choice  function  (SCF)  or  social  welfare  function  (SWF ) 
representing  societal  utility  is  specified 'and  a  resource  allocation 
determined  to  maximize  this  social  welfare  function.  The  SWF  is  then  a 
convenient  form  to  use  to  maximize  group  utility  while  preserving 
equity  considerations  (Keeney  and  Kirkwood,  1975;  Bodily,  1976). 

Consider  again  the  following  formulation  of  society's  economic 
problem.  For  concreteness,  we  shall  assume  a  simple  closed  economy  with 
two  consumers.  We  will  assume  that  the  economy  is  endowed  with  two 
factors,  capital  C  and  labor  L.  There  are  two  outputs  from  production, 
a  (clothing)  and  b  (food).  There  are  fixed  endowments  of  labor  and 
capital  C  and  L  described  by 


C  =  C 


L  +  L. 
a  b 


>  It 


where  C  and  L  are  the  maximum  levels  of  factor  suoplies,  C  and  C-_  are 
the  amount  of  capital  allocated  for  producing  a  and  b  respectively,  and 
La  and  Lb  indicate  the  amount  of  labor  which  is  allocated  for  prod; 
a  and  b  respectively.  The  production  functions  which  determine  the 
amount  of  clothing  and  food  produced  are  given  by 


a  =  q  (Ca,  La; 

b  =  T.  (Cb  ,  Lb) 


;ii 


Two  alternative  actions  (A^,  ) ,  which  are  each  composed  of  different 

production  functions,  have  been  defined.  Each  alternative  action  is 
composed  of  the  four  policy  variables  C  ,  Cb,  L  ,  and  Lb>  In  this 
example,  not  only  will  the  optimum  alternative  which  maximizes  the 
utility  of  the  two  consumers  be  identified,  but  also  the  best  levels  of 


the  policy  variables  for  the  optimum  will  be  found.  We  assume  no  risk 
or  uncertainty  in  this  simplified  example. 

we  assume  that  all  agricultural  and  clothing  production  will  be 
distributed  between  the  two  consumers  as  needed  to  maximize  their  happi¬ 
ness.  Thus  we  have 


a  =  a 


b  =  b 


(19) 

(20) 


where  a^  and  a2  are  the  amount  of  clothes  allocated  to  consumers  1  and 
2  respectively,  and  b1  and  b^  are  the  amount  of  food  allocated  to  con¬ 
sumers  1  and  2  respectively.  The  objective  of  each  consumer  is  to 
maximize  his  or  her  utility. 

we  assume  that  the  utility  of  each  consumer  depends  directly  on 
the  quantity  of  products  consumed.  The  utility  functions  for  the  con¬ 
sumers  are  assumed  to  be  the  isotone  functions 

u1  =  g1  (a-p  b^ )  (21) 

(22) 
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V  n 


u2  r  g2  (a2,  b2) 

Since  we  are  concerned  with  egalatarian  as  well  as  efficiency  considera¬ 
tions,  let  the  SWF  or  SCF  be 

U  =  h  (uv  u2)  (23) 

If  we  now  maximize  with  respect  to  this  SCF,  we  have  in  effect  a  MAUT 
formulation  as 

Max 


u 

(24) 

U1  =  Si 

(ar  b^ 

(25) 

U2  =  §2 

(a2,  b2) 

(26) 

c  =  ca 

+  Cb 

(27! 

E  =La 

+  Lb 

(25) 

a  =  f. 

(Ca,  La)  =  a1  +  a2 

(29) 

b  =f3 

( Cfo ,  L-c )  =  b1  +  b2 

(30 

Now  adjoining  the  constraints  to  U  with  Lagrange  multipliers,  extre- 
mizing  to  obtain  the  necessary  conditions,  and  then  manipulating  these 
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conditions  to  eliminate  the  Lagrange  multipliers  yields  the  three  pre¬ 
vious  efficiency  equations  which  resulted  from  the  optimization  of  the 
component  utility  functions  in  the  MOOT  example  (equations  42,  43,  and 
44;  Chapter  2)  plus  the  social  equity  equation 

3U.j  3U 

3a  3lL 

^  ni 


sa2  3u.j 


where  ~ —  and  — —  indicate  the  marginal  effects  on  U  by  the  utility  of 

3  U  3U2 

consumer  1  and  2  respectively .  This  last  equation  in  effect  picks  a 
point  on  the  HDSS  of  MOOT  formulation.  This  point  is  the  optimal  policy 
that  is  the  most  desirable  with  respect  to  the  SWF.  From  this  example, 
it  is  shown  that  the  necessary  conditions  for  optimality  of  social  wel¬ 
fare  include  all  the  necessary  conditions  for  Pareto  optimality  plus  an 
extra  condition  pertaining  to  egalatarian  considerations.  The  analyst 
optimizes  the  SWF  for  each  alternative  production  system  to  produce 
values  for  allocation  of  resources  and  commodities,  and  a  scalar  score 
reflecting  the  overall  utility  due  to  each  alternative  production 
system.  These  scores  are  used  by  the  DM  as  the  basis  for  identifying 
the  optimal  policy.  Following  a  sensitivity  analysis  and  iteration,  the 
DM  selects  the  optimum  policy  and  proceeds  to  plan  for  implementation. 

The  form  and  parameter  values  of  the  SWF,  U,  are  determined  from 
information  gathered  through  preference  elicitation  (Keeney  and  Raiffa, 
1976;  Dyer  and  Sarin,  1979;  Edwards,  1977). 

A  numerical  realization  of  the  previous  example  will  be  presented 
before  extending  to  the  case  of  multiple  DMs.  Assume  that  a  pre¬ 
analysis  phase  has  established  that  the  form  of  the  objective  functions 
for  the  two  consumers  is 

u1  =  a1  +  b^  (32) 

=  (a2  b2) ( 33 } 
and  two  alternative  production  systems  are  defined  as  follows: 
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Action  A^ 

(use  production 

system  1 ! 

a  =  f, 

(C  ,  L„ }  =  (C 

V5 

(34) 

a  a  3. 

a 

b  =  f2 

V  =  (Cb 

l  r5 

V 

(35; 

Action  A^ 

(use  production 

system  2) 

a  =  f3 

{Ca>  V  =  Ca  " 

-  1. 

(36) 

b  =  f, 

(Cb,  Lb)  =  (Lb! 

i  -  2. 

(37) 

In  this  simplified  example,  we  assume  there  is  no  risk  or  'uncertainty. 

We  assume  preferential  and  utility  independence  such  that  the  form  of  the 
SCF  is 


U  =  k1  u1 


k2  u2 


(3c 


where  and  are  scaling  constants  which  have  been  assessed  to  equal 
.3  and  .7  respectively.  In  sequence,  the  equations  from  each  alterna¬ 
tive  production  system  along  with  the  objective  functions  and  SCF  are 
substituted  into  equations  25,  26,  29,  and  3C  and  the  optimization 
process  is  carried  out.  The  resulting  score  for  alternative  1  is 
3.50  and  the  score  for  alternative  2  is  3.05.  Therefore  the  optimum 
policy  is  to  implement  production  system  1  (A.)  with  5.0  units  of  capi- 

tal  (C„)  and  5.C  units  of  labor  (L  )  going  into  production  of  clothing 
-  -  - 

and  5.0  units  of  capital  (C^)  and  5.0  units  of  labor  (Lb>  going  into 
production  of  food.  This  policy  will  produce  the  allocation  of  0.0 


units  of  clothes  (a^)  and  0.0  units  of  food  to  consumer  1  =  0) 
and  5.0  units  of  clothes  (a-,)  and  5.0  units  of  food  (b^)  to  consumer  2 
(u2  =5). 


A  sensitivity  analysis,  which  would  include  an  examination  of  the 
variation  in  the  optimal  policy  due  to  changes  in  the  form  and  scaling 
constants  of  the  SCF,  would  provide  a  basis  for  validation  of  the  re¬ 
sulting  policy  for  the  DM. 

To  extend  this  example  to  multiple  DMs,  it  is  assumed  that  there 
are  now  two  DMs  who  will  decide  on  which  production  function  to  utilize 
for  society.  Each  of  these  DMs  is  assumed  to  have  their  own  prefer¬ 
ence  for  the  utility  of  the  consumers.  The  problem  of  how  to  amalgamate 


60 


the  two  EM's  preferences  into  a  single  SCF  faces  the  analyst.  The 
difficulty  in  interpersonal  comparison  of  utilities  has  beer,  addressed 
by  Keeney  (1976),  Kirkwood  (1974),  and  Arrow  (1955),  Nakayama,  et  al., 
(1979),  Sage  (1977)  and  others.  Becuase  there  are  two  Dtf's,  a  majori¬ 
ty  voting  scheme  can  be  used  to  combine  the  individual  additive  utility 
functions.  In  a  decision  situation  with  more  than  two  DMs,  the  works  of 
Keeney  (1976),  Kirkwood  (1979),  and  Eliashberg  (197 8)  and  others  can  be 
of  help.  Since  an  additive  combined  SCF  is  assumed,  each  DM ' s  SCF  is 
of  the  form 

U  =  a  ^  U.  +  ( 1  -  ou)  Up  .  (39) 

The  table  below  shows  each  DM's  values: 

DM#  ct  .  1  -  a . 

1  .3  .7 

2  .9  .1 

f 

The  resulting  SCF  U  is  formed  by  averaging  the  individual  scores  >2 

voters  with  equally  weighted  opinions) 

! 

U  =  (.5  a  -|  +  .5  a^U-j  +  (.5(1  -  a.|)  +  .5(1  -  o^)  JU^  (AO) 

The  resulting  SCF  is 

t 

U  =  .6  u^  +  .A  U£  (Al ) 

Using  this  SCF,  the  alternative  scores  become  6.0  and  6.1  for  production 
system  1  and  2  respectively.  These  scores  indicate  that  alternative  2 

/s  /V 

should  now  be  implemented  with  activities  of  CQ  =  10.0,  Cb  =  0.0, 

La  =  0.0,  and  =  10.0  thereby  causing  a  distribution  of  commodities 
of  a1  =  o.o,  3-2  =  0,0>  ^1  =  1.16,  and  b^  =  0.0  (u^  =  10.16,  =  0). 

Pending  a  sensitivity  analysis,  the  optimal  polity  has  been  identified 
for  the  case  of  the  two  DMs. 


5.  Summary 

Tnis  chapter  presents  multiple  attribute  utility  theory  (MAUT)  as 
a  multiple  criteria  approach  to  resolution  of  a  decision  situation. 
MAUT  is  presented  at  two  levels  (theoretical  development  and  practical 


application)  as  a  way  of  elucidating  the  approach  and  to  develop  a 
comparison  basis  with  the  MOOT  presentation  of  Chapter  2.  MAUT  is  pre¬ 
sented  at  the  theoretical  level  for  the  decision  situation  cases  in¬ 
volving  certain  and  uncertain  outcomes.  At  the  practical  application 
level,  the  presentation  of  MAUT  in  the  systems  engineering  format  shows 
that  the  MAUT  process  often  needs  a  MOOT  technique  to  refine  the  deci¬ 
sion  options.  A  welfare  economics  motivated  example  is  presented  that 
shows  the  necessary  conditions  for  maximizing  social  welfare  include 
all  the  necessary  conditions  for  Pareto  optimality  plus  an  extra  condi¬ 
tion  to  preserve  equity  considerations.  The  SWF  criterion  utilizes  a 
MAUT  approach  which  resolves  the  indeterminacy  of  a  Pareto  efficiency 
criterion  in  the  sense  that  it  will  select  a  specific  point  on  the 
Pareto  frontier. 
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CHAPTER  A 


A  COMBINED  MOOT/MAUT  APPROACH  TO  DECISION  SITUATIONS 

1 .  Introduction 

Our  purpose  in  this  research  is  to  motivate  and  present  a  more 
efficient  MCDT  approach  which  combined  features  of  both  the  MOOT  and 
MAUT  approaches.  In  the  previous  chapters,  detailed  descriptions  of 
MOOT  and  MAUT  processes  are  provided  as  useful  frameworks  to  generate 
solutions  to  decision  situations,  and  as  a  basis  for  subsequent  com¬ 
parisons  of  both  approaches.  This  comparison,  which  shows  the  presence 
of  certain  efficient  steps  in  the  approaches  and  the  lack  of  structural 
differences,  leads  to  a  combined  MOOT/MAUT  approach.  This  approach 
is  based  on  the  complementary  aspects  of  both  approaches. 

Section  2  presents  a  comparison  of  MOOT  and  MAUT  with  respect  tc 
their  generic  structure,  function,  pumose  and  organizational  implica¬ 
tions.  Section  3  describes  a  combination  MOOT/MAUT  approach  which 
stresses  the  complementary  nature  of  MOOT  and  MAUT.  A  DELTA  chart  is 
presented  as  an  aid  in  selection  of  an  appropriate  MCDT  approach  tc  a 
decision  situation.  An  example  of  the  combined  MOCT/MaUT  approach  is 
presented  to  illustrate  it  in  an  application. 

2.  Comparison  of  HOOT  and  MAUT  Processes 
2. 1  Structural  Comparison 

The  structural  basis  of  both  MOOT  and  MAUT  processes  produces  a 
set  of  common  characteristics.  Descriptive  of  the  way  either  approach 
actually  organizes  the  decision  situation  elements,  these  characteris¬ 
tics  include: 

*  a  set  of  objectives  (generally  non-commens urate  and  conflicting)  -which 
reflect  the  DM's  values 

*  a  set  of  attributes  for  measuring  attainment  of  objectives 

*  a  set  of  alternative  actions  or  decision  variables 

*  an  elicitation  of  preferences  concerning  the  attributes  from  the  DM 
(required  tc  preserve  ccntextural  integrity) 
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This  set  of  common  characteristics  leads  one  to  expect  the  same  quanti¬ 
tative  solution  from  both  MOOT  and  MALT  processes  when  they  are  applied 
to  che  same  decision  situation.  Indeed,  (as  confirmed  in  Appendix  B', 
this  is  the  case  because  the  MOOT  process  eliminates  dominated  sets  of 
solutions  which  are  not  Pareto  optimal.  Surely  none  of  these  sets 
can  be  optimal  in  MAUT  where  Pareto  optimality  is  a  necessary  condition. 
The  statement  above  requires  assumptions  that  the  DM  is  consistent  with 
respect  to  the  preferences  elicited  in  the  HOOT  and  KAUT  processes  and 
that  both  MOOT  and  MAUT  are  applied  at  the  same  level  of  practice  sc 
the  perceptions  of  the  DM  are  on  the  same  level. 

Referring  to  the  process  and  algorithm  descriptions  in  Chapter  2 
and  3,  one  can  conclude  that  MOOT  and  MAUT  processes  ! at  comparable 
levels)  are  both  mental  constructs  to  approaching  multiple  criteria 
decision  situations  and  that  for  all  intents  and  purposes,  there  are 
no  fundamental  differences  in  structure  between  them.  Both  approaches 
must  be  applied  at  the  same  level  to  insure  that  the  perception  of  the 
situation  is  identical  to  the  DM,  otherwise  there  is  a  possibility  cf  a 
structural  difference  arising  due  to  perception  alone. 

It  is  because  of  the  structural  similarity  of  the  approaches  that 
a  given  decision  situation  can  generally  be  posed  using  either  MOOT  or 
MAUT  processes  to  produce  a  strategically  equivalent  optimal  policy. 

2.2  Function  And  Purpose  Comparison  Of  MOOT  And  MAUT 

MOOT  and  MAUT  were  each  developed  for  different  purposes  which  are 
indicated  by  their  respective  titles.  Multiple  Objective  Optimisation 
Theory  is  designed  to  refine  or  tune  a  set  of  alternative  policies  and 
indicate  impacts  using  a  mathematical  optimization  technique  to  eventu¬ 
ally  form  the  NDSS.  This  mathematical  optimization  requires  precise 
situation  process  descriptions,  but  allows  the  notion  of  time  to  be 
explicitly  included  in  the  model.  At  the  practice  level,  MOOT  separates 
the  optimization  and  decision  making  steps  by  requiring  a  MAUT  technique 
for  the  policy  selection  or  decision  making  step.  Since  a  MAUT  tech¬ 
nique  will  be  used  for  the  decision  making  step,  detail  elicitation  will 
be  eventually  required  tc  establish  the  form  and  constituents  of  the 


scalar  SCF.  Since  the  formation  of  the  SCF  requires  preferential  inde¬ 
pendence  (PI)  of  the  attributes,  this  condition  needs  tc  be  established 
in  all  multiple  criteria  techniques  to  insure  that  the  decision  making 
step  is  mathematically  based  and  an  optimal  policy  can  be  identified 
from  the  NDSS.  MOOT,  therefore,  is  essentially  designed  as  an  impact 
assessment  tool.  Alternately,  Multiple  Attribute  Utility  Theory  is 
designed  to  pose  the  situation  attributes  in  terms  of  the  DM's  utility 
and  then  maximize  this  utility  over  the  policy  alternatives.  At  the 
practice  level,  MAUT  combines  the  optimization/ranking  and  decision 
making  steps  (discounting  any  portion  of  the  optimization  process  re¬ 
quired  to  tune  or  refine  the  alternative  policies).  MAUT  is  essen¬ 
tially  a  decision  making  tool. 

A  major  operational  difference  which  is  apparent  at  the  practice 
level  is  that  the  scalar  social  choice  function  required  for  selection 
of  the  optimal  solution  is  formed  after  the  vector  optimization  and 
generation  of  the  non-dominated  solution  set  in  MOOT,  and  before  ranking 
alternatives  in  MAUT. 

Mathematicians  and  engineers  have  generally  been  involved  in  the 
development  of  MOOT.  It  is  not  surprising  then  that  the  types  of  situa¬ 


tions  v/hich  have  generally  employed  MOOT  techniques  are  those  where  ail 
parts  of  the  problem  are  quantifiable  (because  of  the  mathematical 
optimization  process).  The  relationships  in  the  problem  can  include  time 
dependencies,  and  there  are  physically  motivated  functions,  such  as  in 
resource  allocation  and  profit  maximization  situations.  A  prime  area  of 
MOOT  application  is  in  the  determination  of  optimum  policy  parameters 
for  hardware  subsystem  design. 

Not  only  have  those  with  quantitative  interests  such  as  mathe¬ 
maticians,  economists,  and  engineers  been  involved  in  MAUT,  but  also 
psychologists  and  other  behaviorists  have  made  many  contributions  to 
this  area.  This  influx  of  behaviorists  has  made  MAUT  more  robust  in  areas 
of  application.  The  application  areas  of  MAUT  overlap  those  of  MOOT  and 
extend  to  situations  where  parts  of  the  problem  i  emulation  are  not 
quantifiable.  Many  MAUT  techniques  facilitate  the  quantification  of  the 
qualitative  parts  of  a  decision  situation.  MAUT  is  well  suited  tc 
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behavierally  motivated  criteria.  This  wide  area 


r 


situations  involving 
of  application  makes  MAUT  a  frequently  used  decision  tool.  MAUT  tech¬ 
niques  are  designed  to  indicate  optimal  policies  when  the  decisions  are 
in  the  form  of  a  combination  of  an  alternative  action  and  a  set  of 
discrete  levels  of  the  decision  variable.  This  is  the  form  of  the 
decisions  in  many  situations  with  limited  feasible  options  i. i.e.,  to 
use  a  current  system  or  acquire  a  new  system) . 

The  concept  of  independence  of  objectives  anc  attributes  'with 
respect  to  the  DM '  s  preference  and  utilities  is  of  paramount  importance 
in  MAUT  at  the  practice  level.  This  independence  property  is  linked  tc 
the  general  form  of  the  SCF,  and  must  be  verified  by  the  preference 
elicitation  process  (Keeney  and  Raiffa,  1976). 

2.3  Organizational  Implications  Of  The  Application  if  MOOT  And  MAUT  At 

The  Practice  Level 

When  either  MOOT  or  MAUT  approaches  are  used,  there  is  a  commitment 
made  by  the  using  organization  (organization  here  is  'used  ir.  the  context 
of  a  group  of  stakeholders  including  DM  is)  and  analyst ! s  ir.  either  the 
public  or  private  sectors  who  are  interested  in  resolution  of  the  deci¬ 
sion  situation)  to  dedicate  the  required  resources  toward  producing  a 
solution.  Because  of  the  structural  similarity  of  MOOT  and  MATT 
processes,  much  of  the  information  required  concerning  a  decision  situa¬ 
tion  by  either  process  is  for  all  practical  purposes  identical.  Like¬ 
wise  the  time  requirement  to  carry  out  MOOT  and  MAUT  processes  is  com¬ 
parable  because  similar  functions  must  be  accomplished  with  the  OM  s 


and  other  stakeholders  in  both  processes.  There  are  organizations 
implications  of  the  operational  differences  in  MOOT  which  allow  tit 
to  express  alternative  value  scores  prior  to  optimization,  and  the 
criterion  weights  (for  the  SCF)  following  formation  of  the  KISS, 
the  case  where  contact  between  the  analyst  and  DM  is  limited  t 
short  intervals,  the  MOOT  process  should  be  more  efficient  because  th 
analyst  can  accomplish  the  part  or  ail  cf  optimization  process  t:  for 
the  IJDS3  between  interviews.  In  MATT,  both  the  DM's  value  scores  and 
criterion  weights  must  be  accomoiished  crier  tc  rar.wiru:  alt  err at ives 
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which  may  delay  somewhat,  the  identification  of  the  optimal  policy  in 
the  case  of  restricted  DM-analyst  interaction  mentioned  above.  Very 
often,  limited  contact  with  the  DM(s)  and  the  other  stakeholders  necessi¬ 
tates  certain  assumptions  such  as  linearity  and  risklessness  as  dis¬ 
cussed  by  Edwards  (1977).  While  these  assumptions  limit  the  types  of 
multiple  criteria  analysis  techniques  which  can  be  used,  their  presence 
often  allows  for  a  solution  in  a  pragmatic  manner.  In  these  situations 
of  restricted  DM-analyst  contact,  the  analyst  is  challenged  to  organize 
the  interview  (utilizing  techniques  such  as  prior  construction  of  attri¬ 
bute  templates  for  verification  by  the  DM  and  rapid  screening  of  deci¬ 
sion  options  -  Selvidge,  1976)  so  that  the  essence  of  the  DM's  values 
can  be  rapidly  elicited. 

Before  the  user  proceeds  with  either  a  MOOT  or  MAUT  process,  the 
benefits  and  costs  of  using  a  specific  technique  should  be  examined. 
Certain  authors  suggest  benefit  limits  as  a  GO-NO  GO  threshold  for  com- 
miting  resources  to  a  specific  technique,  or  the  cost  swing  (the  dif¬ 
ference  in  cost  between  the  least  expensive  and  most  expensive  alter¬ 
native  solution)  as  a  limit  of  the  maximum  which  should  be  spent  on 
analysis  for  resolving  a  decision  situation  (Brown  and  Ulvila,  1976).  A 
figure  for  the  cost  of  the  application  of  a  MCDT  approach  can  be  obtained 
from  estimates  of  personnel  experienced  in  this  area,  or  from  the  bids 
of  consulting  firms  who  are  engaged  in  this  business. 

3.  A  Combined  MOOT/MAUT  Approach 

3.1  Complenientary  Aspects  Of  MOOT  And  MAUT 

The  comparisons  just  presented  point  out  that  MOOT  and  MAUT  have 
each  developed  as  methods  primarily  directed  at  two  different  purposes. 
MOOT  is  efficient  at  optimizing  in  the  multiple  criterion  case  while 
MAUT  is  adept  at  incorporating  the  DM  preference  structure  into  the 
decision  making  effort.  As  demonstrated  in  Chapters  2  and  3,  a  pragmatic 
application  of  either  MOOT  or  MAUT  requires  some  interaction  of  both 
approaches.  It  is  logical  to  deduce,  that  the  most  is  gained  by  using 
each  approach  in  a  complementary  fashion  in  the  manner  for  which  each 
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was  developed.  In  this  way  a  multiple  criteria  approach  described  in 
terms  of  systems  methodology  takes  on  an  air  of  synergism  as  steps 
five  ( optimization/ ranking  of  alternatives)  and  six  (decision  making) 
contribute  efficiently  to  the  resolution  of  the  decision  situation. 

3.2  Algorithm  For  The  MOOT/MAUT  Approach 

If  it  appears  cost  effective  to  use  a  MCDT  approach  to  resolve  the 
decision  situation,  then  Figure  1  is  an  aid  which  can  lead  the  user  to 
an  appropriate  technique.  The  DELTA  chart  of  Figure  1  indicates  to  the 
analyst  and  DM  whether  the  combined  MOOT/MAUT  approach  is  appropriate 
for  a  specific  decision  situation.  The  algorithm  for  the  joint  approach 
is  shown  in  Figure  2  as  outlined  below.  This  algorithm  resembles  the 
algorithm  of  the  MOOT  process  at  the  practice  level  because  of  our  non- 
traditional  extensive  description  of  the  MOOT  process.  The  deterministic/ 
non-time  varying  case  is  described  in  this  algorithm  because  of  its 
generality . 

a.  A  pre-analysis  phase  is  accomplished  to  generate  the  input 
description  and  specification  as  discussed  in  Section  3.1  of  Chapters 
2  and  3. 

b.  A  systems  analysis/modelling  phase  is  directed  toward  con¬ 
structing  the  situation  process  so  that  impacts  of  the  various  alterna¬ 
tive  policies,  as  discussed  in  Section  3.1  of  Chapters  2  and  3,  will  be 
produced. 

c.  Identification  of  feasible  alternatives  is  the  next  step  prior 
to  optimization. 

The  generation  of  a  set  of  alternative  actions  from  which  to  choose 
is  accomplished  in  system  synthesis.  In  an  effort  to  cause  the  DM  to 
think  in  a  comprehensive  and  thorough  manner,  the  analyst  should  en¬ 
courage  the  DM  to  consider  as  many  alternatives  as-  possible.  Analysts 
and  others  on  the  DM’s  staff  may  be  of  considerable  assistance  in  this 
regard.  Logical  steps  in  identifying  the  feasible  alternatives  are  to 
list  the  possible  alternative  acts  and  then  eliminate  the  improper  acts. 
This  reduction  of  the  decision  space  to  include  the  feasible  alternatives 
is  usually  accomplished  to  seme  degree  by  the  DM  (perhaps  subconsciously) 
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Decision  Maker  and 
I  Analyst  decide  to 
utilize  MCDT  lor 
policy  selection 


/  Are  there  \ 

/ numerous  objeet-'v 
/ ives  and  accompany-  'v 
ins  attributes  at*  the' 
preferred  level  of 
ataiysis  of  the 
Sydecision  situation?  / 


Are  the 
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PI? 


Do  not  use 
a  "CD? 
approach 


Use  a  MOD?  v£2 
approacli 


/  Car  the  \ 
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\that  they  are  / 
\  PI?  / 


A>o  the  \ 

/ policies  \ 
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/  ment  before  beings 
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'decision  options?/ 


Do  r.ot  use  a 
KCD?  approach 
sir.ee  an 
optimal  policy 
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tified  bv 
analytic  means 


Use  a  "CO? 
technique  for 
the 

optimization 
_ step 


X;ill  it 

/possible  and  'v 
/desirable  to  fori\ 
a  scalar  SCK  be! ore 
optimization?  / 


1  OB  ! 

Use  the  jeinl 
MO0T/HAU7 
apr> roach  for 
optimized  ion 


Use  a  XAU?  tech¬ 
nique  to  elicit 
the  D"’s  preferences 
to  fort  a  ECF  and 
idontily  the  optimal 
policy 


lr  rccori-\. 
Vi  ended  policy 
inpleacntatlcV 


using  seme  version  of  lexicographic  ordering  or  elimination  by  aspects. 
The  elimination  by  aspects  procedure  ( Tversky ,  1971 )  compares  the  alter¬ 
natives  by  looking  at  specific  attributes,  and  eliminates  alternative 
policies  which  do  not  meet  minimum  requirements  for  one  or  more  aspects 
of  decision  situation  resolution.  The  analyst  continues  this  refinement 
of  alternatives  with  the  DM  until  an  appropriate  set  of  alternative 
policies  is  produced.  Elimination  by  aspects  usually  requires  that  the 
attainment  levels  of  the  attributes  are  continually  made  more  restric¬ 
tive  until  only  one  alternative  remains.  In  our  approach,  a  set  of  mini¬ 
mum  attainment  levels  is  obtained  and  if  more  than  one  alternative  re¬ 
mains,  other  means  as  described  below  are  used  to  select  the  optimum 
alternative.  This  generally  allows  a  successful  tradeoff  between  flex¬ 
ibility,  time,  and  tractability. 

d.  Optimization  of  the  multiple  objective  functions  is  then 
accomplished.  Optimization  of  the  multiple  objective  functions  is  re¬ 
quired  because  the  scalar  SCF  has  not  yet  been  formed  (which  wo.uld 
require  optimization/ranking  of  alternatives  only  with  respect  to  a 
scalar).  In  the  optimization  process,  the  analyst  uses  one  of  the 
mathematical  optimization  techniques  to  refine  or  tune  the  decision 
variables  in  each  alternative  Dolicy  to  produce  the  best  candidate  forms 
of  each  alternative  policy.  Using  these  robust  forms  of  mathematical 
optimization  allows  the  model  to  deal  explicitly  with  the  notion  of  time 
and  to  show  precisely  the  impacts  from  the  policies.  The  implementa¬ 
tion  of  this  optimization  process  is  discussed  in  Section  2.1  of  Chapter 
2. 

e.  The  elimination  of  dominated  alternatives  is  accomplished  to 
reduce  the  decision  space  to  only  those  alternative  policies  which  have 
attribute  levels  which  are  non-dominated,  bearing  in  mind  the  caveat 
discussed  previously  concerning  elimination  of  an  alternative  which  is 
not  dominated  by  a  majority  of  other  alternatives.  The  efficient  set  of 
the  best  candidate  forms  of  the  alternative  policies  then  forms  the 
NDSS.  In  some  cases,  it  may  be  reasonable  to  form  a  feasible  essen¬ 
tially  NDSS.  For  instance,  Figure  3  shows  a  set  of  solutions  for  the 
two  attribute  case.  The  strict  NDSS  is  composed  of  solutions  a,  F,  c, 
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d,  e.  But  for  a  DM  who  values  both  attributes,  solutions  a  and  e  are 
not  very  good  (although  they  are  non-dominated ) ,  and  solution  7  is  very 
good  (although  it  is  dominated).  In  this  case,  it  would  seem  reasonable 
to  form  a  feasible  essentially  NDSS  composed  of  solutions  b,  c,  d,  7 
which  should  be  examined  closer  for  selection  of  the  optimum. 

f .  The  policy  selection  phase  is  a  MAUT  exercise  where  the  prefer¬ 
ences  of  the  DM  are  elicited  to  form  a  scalar  SCF.  This  process  is 
discussed  in  Chapter  3  as  well  as  described  by  Keeney  and  Raiffa  (1976), 
and  Dyer  and  Sarin  (1973).  This  SCF  then  becomes  the  scoring  criterion 
by  which  the  members  of  the  NDSS  are  evaluated  and  ranked.  The  optimal 
policy  is  then  identified  and  presented  to  the  DM  for  consideration. 

g.  An  analysis  of  results  is  conducted  to  evaluate  the  sensitivity 
of  the  solution  to  variation  in  parameters.  Critical  parameters  are 
identified,  and  an  improvement  in  the  accuracy  of  these  parameters  is 
attempted.  The  final  step  in  the  algorithm  is  planning  for  implementa¬ 
tion  of  the  optimum  policy. 

This  algorithm  is  iteratively  applied  until  nc  significant 
change  occurs  in  the  results.  Overall,  this  algorithm  which  allows  each 
of  MOOT  and  MAUT  to  be  used  in  individually  specialized  but  complemen¬ 
tary  steps  is  more  efficient  than  resolving  the  decision  situation  with 
either  approach  alone.  Modifications  to  this  algorithm  due  to  uncer¬ 
tainty  of  outcome  and  time  varying  relationships  are  discussed  for  the 
various  parts  of  the  algorithm  in  Chapters  2  and  3.  Likewise,  the 
general  input  requirements  and  output  results  for  the  MOOT/MAUT  approach 
are  summarized  under  the  MOOT  and  MAUT  descriptions  in  Chapters  2  and  3. 

The  benefits  of  the  combined  MOOT/MAUT  approach  compared  to  either 
process  are  as  follows:  there  is  more  efficient  resolution  of  decision 
situations  because  of  the  complementary  nature  of  the  combined  pro¬ 
cesses  (accomplish  the  required  optimization  with  the  technique  designed 
for  efficient  optimization — MOOT,  and  accomplish  the  required  ranking  of 
alternatives  and  decision  making  with  the  technique  designed  for  this 
purpose — MAUT) ;  this  combined  approach  can  be  used  if  there  is  limited 
access  to  the  DM  because  the  interview  time  can  be  partitioned  into 
elicitation  of  alternate  act  scores  or  utilities,  and  criterion  or 
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attribute  weights  elicitation,  while  allowing  the  analyst  to  continue 
in  the  modelling  and  optimization  steps  between  these  elicitations.  The 
main  cost  of  the  combined  MOOT/MAUT  approach  compared  to  either  approach 
alone  is  an  expected  increase  in  computer  resources  utilized  particularly 
as  the  number  of  attributes  increases.  Table  1  includes  comments  on  the 
costs  and  benefits  of  the  approaches. 


A.  An  Example  Of  The  MOOT/MAUT  Process 

The  following  is  an  example  to  illustrate  the  combined  MOOT/MAUT 
process.  This  example  is  very  similar  in  form  to  the  MOOT  process 
example  (Chapter  2)  because  of  our  inclusion  of  a  choice  function  based 
on  utility  theory  in  the  decision  making  step  of  that  example.  This 
example  will  also  be  from  the  area  of  welfare  economics. 

Welfare  economics  is  that  branch  of  economics  which  deals  with 
the  distribution  and  consumption  of  resources  for  the  public  good  as 
opposed  to  the  individual  good.  The  general  objective  of  welfare 
economic  analysis  is  the  evaluation  of  economic  alternatives  and 
redistribution  of  economic  resources  for  maximum  societal  benefits.  An 
allocation  of  resources  in  Pareto  optimal  when  no  other  reallocation  of 
production  and  distribution  will  increase  the  economic  satisfaction  of 
any  one  individual  without  decreasing  the  satisfaction  level  of  others 
in  society. 

Consider  the  following  formulation  of  society’s  economic  problem. 
For  concreteness,  we  shall  assume  a  simple  closed  economy  with  two  con¬ 
sumers.  We  will  assume  that  the  economy  is  endowed  with  two  factors, 
capital  C  and  labor  L.  There  are  two  outputs  from  production,  a 
(clothing)  and  b  (food).  There  are  fixed  endowments  of  labor  and  capi¬ 
tal  C  and  L  described  by 

C  =  Ca  +  CH  (1) 

a  b 

C  s  L,  +  L  (2) 

a  b 

where  Z  and  E  are  the  maximum  levels  of  factor  supplies,  C  and  Ch  are 
the  amount  of  capital  allocated  for  producing  a  and  b  respectively,  and 
La  and  Lb  indicates  the  amount  of  labor  which  is  allocated  for  producing 
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a  and  b  respectively.  The  production  functions  which  determine  the 
amount  of  clothing  and  food  produced  are  given  by 

a  =  ft  (Ca,  La)  (3) 

b  =  fj  (Cb’  Lb)  (4) 

Two  alternative  actions  (A^,  Ag),  which  are  each  composed  of  different 
production  functions,  have  been  defined.  Each  alternative  action  is 
composed  of  the  four  policy  variables  Ca>  C^,  L  ,  L^.  In  this  example, 
not  only  will  the  optimum  alternative  which  maximizes  the  utility  of 
the  two  consumers  be  identified,  but  also  the  best  levels  of  the  policy 
variables  for  the  optimum  will  be  found. 

We  assume  that  all  agricultural  and  clothing  production  will  be 
distributed  between  the  two  consumers  as  needed  to  maximize  their  happi¬ 
ness.  Thus  we  have 

a  =  a1  +  a2  (5) 

b  =  b1  +  b2  (6) 

where  a1  and  a2  are  the  amount  of  clothes  allocated  to  consumers  1  and 
2  respectively,  and  b^  and  b2  are  the  amount  of  food  allocated  to  con¬ 
sumers  1  and  2  respectively.  The  objective  of  each  consumer  is  to  max¬ 
imize  his  or  her  utility. 

We  assume  that  the  utility  of  each  consumer  depends  directly  on  the 
quantity  of  products  consumed.  The  utility  functions  for  the  consumers 
are  assumed  to  be  the  isotone  functions 

u1  =  g1  (a.,,  b.,)  !7) 

u2  —  g2  ( a2 ,  b2 )  v  S ) 

The  vector  of  objectives  functions  is  defined  as 

Max  J  =  Max  (u^ ,  Ug)  (9) 

An  elimination  by  aspects  effort  is  conducted  by  setting  minimum 
attainment  levels  of  the  attributes  to  determine  if  any  alternatives  or 
forms  of  alternatives  should  be  eliminated  from  consideration.  This 
process  will  usually  reduce  the  decision  space,  and  hence  one  must  be 
careful  to  justify  the  minimum  attainment  levels  so  as  to  prevent 
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elimination  of  an  alternative  on  a  single  unfounded  aspect.  The  opti¬ 
mization  step  commences  with  the  optimization  of  one  objective  function 
while  holding  the  value  of  the  other  objective  function  constant. 

Now  we  can  pose  the  above  problem  as 


Max 

U1 

(10) 

subject 

to  U2  = 

n2 

(11) 

C  = 

Ca 

+  cb 

(12) 

I  = 

La 

+  Lb 

(13) 

a  = 

fi 

{Ca> 

La>  *  al  ♦  a2 

( 14) 

b  = 

f; 

(Cb’ 

V  =  bl  *  b2 

(15) 

where  u^is  a  specific  level  of  utility  for  consumer  2.  Now  adjoining 
the  constraints  to  u^  with  Lagrange  multipliers  and  optimizing  yields 
optimal  values  for  the  policy  variables. 

The  optimization  problem  is  optimized  many  times  for  various 
values  of  ( effectively  this  is  allowing  the  Lagrange  multiplier  to 
change  values ) .  Iterating  the  optimization  procedure  with  each  alter¬ 
native  for  various  values  of  u2  will  produce  solutions  which  are  Pareto 
optimal  for  each  alternative.  After  the  set  of  feasible  optimal  solu¬ 
tions  has  been  generated,  a  digital  computer  sub-routine  can  be  used  to 
find  the  non-dominated  solution  set  (NDSS).  We  will  call  the  NDSS  the 
set  Y.  A  MAUT  technique  is  used  in  the  policy  selection  step  where 
the  preferences  of  the  DM  with  respect  to  the  attributes  are  used  to 

A 

construct  a  scalar  social  choice  function  (SCF).  This  SCF  (Y  =  f  (u^, 
u2 ) ) is  used  to  select  the  best  solution  from  among  the  NDSS.  Assuming 
that  difference  independence  (in  addition  to  preferential  independence) 
among  the  attributes  holds  (Dyer  and  Sarin,  1979),  the  form  of  the 
SCF  is 

Y  =  a*U^+(1-a)*u2  (16) 

After  the  scaling  constant,  a,  has  been  assessed  (Dyer  and  Sarin,  1979), 

A 

the  specific  solutions  in  Y  (NDSS)  are  ranked  by  Y  and  the  best  solu¬ 
tion  is  identified.  This  algorithm  will  score  each  member  of  the  NDSS 

A 

and  produce  a  set  of  Y  for  the  NDSS. 
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When  maximum  Y  =  Y*  is  found,  this  solution  can  be  traced  back  to 

A 

a  specific  action  or  A2  (depending  on  whether  Y*  came  from  the  A.  or 
optimization  process).  This  action  ( A^  or  A^)  can  then  be  related 
to  the  optimum  levels  of  the  decision  variables  Ca,  Cb,  La,  and  Lb. 

The  sought  after- solution  includes  the  identification  of  the  optimum 
distribution  of  commodities  a^,  a^,  6^,  and  b^  which  would  result  from 
the  optimal  policy.  Iteration  of  the  MOOT  procedure  along  with  a  com¬ 
prehensive  sensitivity  analysis  gives  the  DM  an  idea  of  the  robustness 
of  the  optimal  policy.  An  action  plan  for  implementation  of  the  optimal 
policy  would  normally  follow. 

A  numerical  realization  of  the  previous  example  will  be  presented 

before  extending  the  example  to  the  case  of  multiple  DMs.  Assume  that 

a  pre-analysis  phase  has  established  that  the  form  of  the  objective 
functions  for  the  two  consumers  is 

u1  :  a1  +  b1  (17) 

u2  =  (a2  b2)*5  (IS) 

and  two  alternative  production  systems  are  defined  as  follows: 


Action  A^  (use  production  system  1) 

a  =  f,  (Ca,  l.a)  ,  (CaLa)'5  119) 

b  =  f2  (Cb,  Lb)  =  (Cb  Lb)'5  (20) 

Action  A2  (use  production  system  2) 

a  =  f3  (Ca,  La)  =  Ca  -  1.  .21) 

b  =  f4  (Cb,  Lb)  =  (Lb)'5  -  2.  (22) 


In  this  simplified  example,  we  assume  there  is  no  risk  or  uncertainty. 

An  elimination  by  aspects  exercise  establishes  ‘'hat  no  policy  forms 
with  u1  <  2.  and  u2  <  1.5  will  be  allowed.  In  sequence,  the  equations 
from  each  alternative  production  system  along  with  the  objective  func¬ 
tions  are  substituted  into  equations  10,  11,  14  and  15  and  the  optimiza¬ 
tion  process  is  carried  out.  Now  each  value  function  is  optimized  for 
both  alternative  systems.  The  solutions  for  the  proposed  alternative 
systems  1  and  2  and  the  resulting  NDSS  are  shown  on  Figure  Assume 
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that  the  attributes  are  preference  independent,  and  that  the  SCF  has 
been  determined  to  be 

Y  =  v  u1  u2  (23) 

where  v  is  a  constant  determining  a  family  of  isopreference  curves.  This 
SCF  is  tangent  to  the  NDSS  at  v  =  0.08  at  point  T  in  Figure  A.  Point 
T  is  then  the  optimum  policy  of  implementing  production  system  1(A.) 
with  5.0  units  of  capital  (C  )  and  5.0  units  of  labor  (L_)  going  into 
production  of  clothing  and  5.0  units  of  capital  (Cb)  and  5.0  units  of 
labor  (Lfa)  going  into  production  of  food.  This  policy  will  produce  the 
allocation  of  2.5  units  of  clothes  (a^)  and  2.5  units  of  food  (b^  to 
consumer  1  (in  =  5),  and  2.5  units  of  clothes  (a2)  and  2.5  units  of 
(b2)  food  to  consumer  2  (i^  =  2.5). 

A  sensitivity  analysis  would  give  feedback  as  to  the  validity  of 
this  consensus  opinion  before  implementation  is  actually  planned.  In 
this  sensitivity  analysis  we  would  include  an  investigation  of  the  impact 
on  optimal  policy  identification  that  the  variation  in  scaling  parameter 
values  cause. 

The  deviation  required  in  the  MOOT/MAUT  process  for  multiple  DMs 
is  similar  to  those  for  either  the  MOOT  or  MAUT  process.  These  devia¬ 
tions  from  the  processes  for  a  single  DM  are  described  in  Section  A  of 
Chapters  2  and  3. 


In  this  chapter,  both  MOOT  and  MAUT  processes  were  compared  and 
contrasted  with  respect  to  structure,  function,  purpose  and  resulting 
organizational  implications.  While  there  are  operational  and  philoso¬ 
phical  differences  between  MOOT  and  MAUT,  both  approaches  are  mental 
constructs  to  approaching  decision  situations  and  when  compared  at  the 
same  level,  there  are  for  all  intents  and  purposes,  no  differences  in 
the  structure  between  them.  As  demonstrated  in  examples  and  confirmed 
in  Appendix  B,  both  approaches  are  capable  of  producing  either  identical 
or  strategically  equivalent  policies  when  applied  at  the  same  level  to  a 
common  decision  situation.  The  comparison  shows  that  MOOT  is  adept  at 
solving  hardware  oriented  (elements  are  quantifiable)  parameter  design 
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problems  which  may  be  time  dependent,  while  MAUT  is  well  suited  for  a 
wide  range  of  application  including  those  with  behavioral  aspects  (in¬ 
cluding  qualitative  elements).  Next,  an  investigation  of  the  organiza¬ 
tional  implications  of  use  of  both  approaches  produced  the  observation 
that  the  only  generally  significant  variant  with  respect  to  information, 
cost,  and  time  requirements  of  either  process  is  the  flexibility  in  the 
MOOT  process  which  allows  the  contact  time  to  be  divided  between 
analyst  and  DM  into  several  elicitation  sessions  without  unnecessarily 
delaying  the  process. 

As  one  examines  MOOT  and  MAUT  at  the  practice  level,  a  certain 
amount  of  mixing  of  both  approaches  becomes  apparent.  Therefore,  it  is 
logical  to  combine  both  approaches  into  a  common  multiple  criteria 
s^oiergistic  approach  which  takes  advantage  of  their  complementary  nature 
for  better  resolution  of  decision  situations.  This  combined  approach 
allows  portions  of  each  of  MOOT  and  MAUT  to  be  used  efficiently  in  an 
appropriate  step  of  the  systems  engineering  methodology.  A  DELTA 
chart  (Figure  1)  is  presented  to  aid  decision  makers  and  analysts  in 
choosing  the  correct  approach  to  use  in  modelling  and  resolving  a  large- 
scale  decision  situation. 
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CHAPTER  5 

AN  APPLICATION  OF  MULTIPLE  CRITERIA  DECISION  THEORY 
TO  ELECTRONIC  WARFARE  AIRCRAFT  RETROFIT  DESIGN 

1 .  Introduction 

The  retrofit  of  a  particular  aircraft,  with  equipment  designed  for 
a  mission  the  aircraft  was  not  originally  intended  to  fly,  is  a  complex 
and  time  consuming  process.  When  U.S.  Air  Force  requirements  for  a  spe¬ 
cial  purpose  aircraft  (electronic  warfare,  reconnaissance,  etc.)  are 
developed,  there  is  generally  a  concerted  effort,  for  economic  reasons 
and  reasons  of  time  to  completion  of  effort,  to  modify  an  existing  air¬ 
frame  as  opposed  to  designing  an  entirely  new  one.  Difficulty  arises 
concerning  how  to  fit  a  wide  variety  of  equipment  into  an  airframe  and 
also  satisfy  all  concerned  parties  with  respect  to  cost,  performance, 
and  schedule  (OMB  1976;  USAF,  1976b).  Previous  efforts  at  Electronic 
Warfare  Aircraft  Retrofit  Design  (EWARD)  have  met  with  limited  success 
(Peterson,  et  al.,  1975;  Cook,  1977).  The  basic  problem  is  that  the 
retrofit  aircraft  is  often  not  what  the  users  originally  asked  for  or 
need.  Instead,  the  retrofit  generally  results  in  an  aircraft  which  often 
does  not  sufficiently  ameliorate  deficiencies  which  led  to  the  design 
requirement.  A  combination  of  budgetary,  political  and  technical  fac¬ 
tors  often  leads  to  system  development  delays.  This  often  results  in  a 
system  being  developed  in  a  later  time  frame  than  the  one  which  it  was 
needed  and  the  one  in  which  design  requirements  were  specified. 

Current  directives  (OMB,  1976;  DOD,  1977a;  USAF,  1977a;  USAF, 

1976a)  stress  the  incorporation  of  the  systems  oriented  approach  and 
evaluation  criteria  concerning  performance,  cost  and  schedule.  As 
stated  in  DODD  5000.1:  "System  development  shall  be  continuously  evalu¬ 
ated  against  these  requirements  (programs  and  equipment  which  exhibit 


timely  development  and  high  performance  at  a  minimum  cost)  with  the  same 
rigor  as  that  applied  to  technical  requirements.  Practical  tradeoffs 
shall  be  made  between  system  capability,  cost  and  schedule."  There  are 
many  obstacles  to  implementing  the  spirit  of  these  current  directives 
as  will  be  described  in  Section  2. 

The  purpose  of  this  effort  is  to  illustrate  how  multiple  criterion 
decision  theory  (MCDT)  can  be  applied  to  the  specific  application  area 
of  an  initial  phase  of  the  DOD  Equipment  Acquisition  Cycle  for  an  ■elec¬ 
tronic  warfare  aircraft  retrofit  design  (EWARD).  A  combined  multiple 
objective  optimization  theory /multiple  attribute  utility  theory  (MOOT/ 

MAUT)  approach  was  applied  to  EWARD  to  investigate: 

1.  If  a  multiple  criteria  decision  theory  (MCDT)  approach  can 
improve  the  EWARD  process. 

2.  If  application  of  a  combined  approach  using  both  MOOT  and  MAUT 
has  merit. 

3.  If  an  adequate  set  of  criteria  can  be  generated  to  judge  the 
goodness  of  alternative  designs  early  in  the  EWARD  process  v Table  1 ) 

The  retrofitting  of  a  special  purpose  EW  aircraft  is  a  large-scale 
system  problem  because  of  the  political,  military,  economic,  and  tech¬ 
nical  overtones.  EWARD  requirements  are  therefore  appropriated  candidates 
for  an  approach  using  systems  engineering  methodology  and  MCDT  within 
this  methodology.  The  first  three  steps  of  problem  definition,  value 
system  design,  and  system  synthesis  were  accomplished  (Section  3),  and 
then  a  combined  MOOT/MAUT  approach  was  used  to  perform  the  next  steps 
(modelling  and  systems  analysis,  ranking  alternatives/decision  making) 
as  described  in  Section  4.  The  solution  obtained  from  this  approach  to 
EWARD  was  validated  on  an  EW  aircraft  now  in  operation  using  appropriate 
data  and  Government  advisors  and  decision  makers  (DMs). 
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Table  1 

_ Criteria  for  an  EW  Retrofit  System 

1.  Technical:  EW  Aircraft  Aerodynamic  Performance 

a.  EW  System  Weight 

b.  EW  System  Volume  Required 

c.  EW  System  Power  Required 

2.  Economic:  EW  Retrofit  System  Life  Cycle  Cost 

3.  Military:  Retrofit  System  Electronic  Warfare 

Performance 

a.  Aircrew  Performance 

b.  Nurrber  of  Threats  Degraded 

c.  Nurrber  of  Threats  Defeated 

4.  Political:  National  Policy  Satisfaction 


2.  The  Electronic  Warfare  Aircraft  Retrofit  Decision  Situation 


The  retrofitting  of  equipment  to  satisfy  a  particular  need  is  not 
a  new  concept  in  military  or  civilian  history.  The  size  and  complexity 
of  current  retrofit  efforts  in  the  EWARD  situation  in  the  U.S.  and  the 
associated  political,  economic,  military  and  technical  impacts  make  this 
a  large-scale  system  problem.  The  economic  concerns  are  felt  from  the 
emphasis  of  the  U.S.  Congress  and  upper  echelon  military  policy  makers 
who  must  consider  budgetary  constraints  and  alternate  program  trade¬ 
offs.  The  size  of  the  problem  is  significant  when  one  considers  that  a 
fleet  of  fully  equipped  EW  aircraft  can  cost  ten  times  the  price  of  the 
original  aircraft.  The  political  factors  are  also  considerable  when  the 
governmental  policy  makers  consider  the  ramifications  of  putting  certain 
equipment  on  the  aircraft  which  impact  U.S.  security,  NATO  agreements, 

SALT  talks,  foreign  weapons  sales,  etc.  The  technological  concerns, 
while  easier  to  quantify,  are  nevertheless  substantial  when  one  consid¬ 
ers  the  problem  of  fitting  sophisticated  electronic  equipment  into  an 
airframe  designed  primarily  to  carry  ordinance.  The  problem  of  size, 
weight,  volume,  antennas,  power  type,  air  crew  requirements,  etc.  must 
be  considered  (Cook,  1977  ;  Peterson,  et  al.,  1975;  USAF,  1977a).  Opti¬ 
mization  techniques  which  consider  only  the  technical  aspects  of  the 
retrofit  design  problem  have  met  with  only  limited  success  (Peterson, 
et  al. ,  1975) . 

To  give  an  appropriate  perspective,  from  which  the  difficulty  in 
the  retrofit  design  of  an  EW  aircraft  is  apparent,  the  prescribed  retro¬ 
fit  procedure  will  be  presented  along  with  a  set  of  impediments  to 
enactment  of  this  process.  Figure  1  shows  the  phases  of  an  EW  retrofit 
system  program  as  viewed  by  government  program  managers.  The  five 
phases  of  Conceptual,  Validation,  Development,  Production,  and  Deployment 
contain  various  funding  decision  points.  The  stakeholders  are  amalgamated 
into  three  groups.  Group  G-1  (Operations  and  Intelligence)  is  composed 
of  the  system  users  (using  commands,  Strategic  Air  Command  -  SAC, 

Tactical  Air  Command  -  TAC,  etc.)  and  the  intelligence  community. 

Group  G-2  (Government  policy)  is  made  up  of  Headquarters  U.S.  Air  Force 
(Hq.  USAF),  Congress,  and  the  executive  branch.  Group  G-3  (Technical 
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Figure  1.  Defense  Systems  Equipment  Program  Phases 
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development  and  assessment)  is  made  up  of  the  industrial  contractors, 
and  in-house  government  development,  contract  monitoring  and  user  inter¬ 
facing  subgroups  (Air  Force  Systems  Command  -  A FSC,  and  Air  Force  Log¬ 
istics  Command  -  AFLC).  Decision  makers  and  advisors  from  these  three 
groups,  who  are  involved  in  EW  equipment  acquisition,  took  part  in  this 
effort. 

2. 1  Specified  EW  Retrofit  Procedure 

The  USAF  is  guided  in  the  procurement  of  military  equipment  by 
various  regulations  and  directives  (eg.,  DOD,  1977a;  USAF,  1966b).  The 
following  discussion  describes  the  prescribed  way  that  an  EW  retrofit 
is  accomplished  in  the  U.S.  Air  Force.  The  process  starts  with  the 
identification  by  the  using  commands  in  group  G-1,  or  the  intelligence 
community,  of  a  deficiency  or  need.  Figure  2  illustrates  the  process. 
This  deficiency  can  be  a  previously  recognized  weakness  which  now  can  be 
corrected  through  successful  efforts  of  government  laboratories  or  in¬ 
dustrial  contractors  through  the  acquisition  of  a  new  system.  This 
deficiency  or  need  is  presented  by  the  using  command  to  Headquarters  Air 
Force  (Hq.  USAF)  in  the  form  of  a  statement  of  need  (SON),  and  this  is 
where  group  G-2  becomes  involved  (USAF,  1978).  If  the  initial  estimate 
of  system  research,  development,  test,  and  evaluation  (RDT  &  E)  exceeds 
$75  million  or  $300  million  in  production,  the  program  is  designated 
a  major  systems  acquisition.  As  a  major  systems  acquisition,  the 
Defense  Systems  Acquisition  Review  Council  (DSARC)  review  program  is  re¬ 
quired.  The  Mission  Element  Need  Statement  (MENS)  is  next  generated 
which  must  identify  the  mission  need  in  terms  of  the  task  to  be  per¬ 
formed,  assessment  of  projected  enemy  threat,  and  existing  DOD  capabil¬ 
ity  (DOD,  1977b).  Hq.  USAF  reviews  the  MENS  and  forwards  it  to  the 
Secretary  of  the  Air  Force  (SAF)  who  approves  it  and  sends  it  to  the 
Secretary  of  Defense  (SECDEF)  for  final  approval,  or  redirects  it  for 
appropriate  modification  or  termination.  If  the  need  is  judged  as 
legitimate  and  current  by  the  SECDEF,  the  program  is  initiated  (mile¬ 
stone  0)  by  authorization  of  funds  for  the  Conceptual  Phase. 

A  DELTA  chart  documenting  the  Conceptual  Phase  is  illustrated  in 
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Figure  3.  Funding  is  made  available  to  a  System  Program  Office  (SPO) 
cadre  in  group  G-3  to  define  the  acquisition  problem,  identify  program 
objectives  and  goals,  and  alternative  candidate  systems.  The  SPO  also 
develops  models  to  evaluate  operational  considerations,  acquisition  ap¬ 
proaches  and  associated  risk  factors.  Using  cost  and  performance  trade¬ 
offs,  candidate  systems  are  evaluated  to  identify  one  or  more  alterna¬ 
tives  for  entry  into  the  Validation  Phase.  Next,  development  of  a  Pro¬ 
gram  Management  Plan  (PMP)  is  undertaken  as  the  summary  of  the  previous 
efforts'.  The  PMP  is  used  as  the  basic  document  defining  pertinent  as¬ 
pects  of  the  retrofit  system.  The  PMP  is  used  to  prepare  the  Program 
Management  Directive  (PMD)  which  summarizes  the  previous  efforts  in  the 
Conceptual  Phase,  and  presents  a  plan  for  proceeding  into  the  Validation 
Phase.  Hq.  USAF  uses  the  PMD  to  generate  the  Decision  Coordinating 
Paper  (DCP)  as  input  to  the  Air  Force  Systems  Acquisition  Review  Council 
( AFSARC ) .  AFSARC  makes  recommendations  on  the  program  and  forwards 
these  to  the  SAF.  If  the  DCP  is  approved,  it  is  passed  to  the  DSARC 
(milestone  I)  for  action.  Following  recommendations  by  DSARC,  the 
SECDEF  is  tasked  with  final  decision  on  the  program.  If  approval  is 
granted,  funding  authorizes  proceeding  into  the  Validation  Phase.  The 
Conceptual  Phase  is  purely  a  "paper"  effort  with  no  funding  authorized 
for  hardware. 

The  Validation  Phase  is  illustrated  in  Figure  4.  When  the  Validation 
Phase  is  authorized  by  the  SECDEF,  a  SPO  (G-3)  is  tasked  with  generating 
the  basis  from  which  one  or  more  contractors  are  selected  to  go  into  the 
Development  Phase.  Validation  is  achieved  through  either  a  contract 
definition  (paper  design)  or  a  prototype  (hardware  demonstration)  ap¬ 
proach.  In  the  "contract  definition"  approach,  usually  two  (or  more) 
contractors  are  allowed  to  compete  with  each  other  in  an  attempt  to 
further  define  and  refine  the  system.  A  Request  for  Proposal  (RFP)  is 
issued  which  initiates  the  paper  study.  The  results  of  this  phase  are 
system  specifications  and  a  statement  of  work.  A  source  selection  team, 
including  representatives  from  G-1,  G-2  and  G-3,  selects  the  most  attrac¬ 
tive  contractors  from  the  competing  group.  A  RFP  is  issued  and  funding 
negotiations  for  the  Development  Phase  are  completed  with  the  selected 


contractors.  In  the  "prototype"  approach,  a  Development  Concept  Paper 
(DCP)  from  the  Service  Secretary  (G-2)  initiates  the  process.  A  formal 
RFP  is  distributed  to  industry,  and  a  Source  Selection  Team  usually 
chooses  one  or  more  contractors  to  continue  as  a  result  of  the  submitted 
proposals.  The  selected  contractors  fabricate  a  hardware  version  of  the 
system  under  development.  This  hardware  system  is  evaluated  analytically 
in  a  demonstration  or  "fly-off"  exercise.  During  this  evaluation,  a  RFP 
is  prepared  for  Full-Scale  Development,  and  the  most  satisfactory  com¬ 
petitor  is  selected  for  further  development.  In  either  contract  defini¬ 
tion  or  prototype  approaches,  a  P.MP  is  prepared  next,  followed  by  the 
DCP  and  PMD,  and  a  DSARC  board  meets  for  milestone  II  ! G— 1 ,  G-2,  G-3,  to 
judge  the  worthiness  of  the  program  to  proceed.  If  the  program  is  judged 
essential  and  proceeding  satisfactorily,  the  SECDEF  acts  on  the  program. 
If  the  program  is  approved,  a  PMD  (G-2)  is  sent  to  the  SPO  and  funding  is 
approved  as  authorization  to  proceed  to  the  Full  Scale  Development 
Phase.  Other  alternative  actions  to  proceeding  into  Development  are  to 
return  to  more  validation,  or  cancellation. 

The  Full-Scale  Development  Phase  provides  the  expanded  engineering 
design,  fabrication,  testing,  evaluation,  and  support  planning  for  the 
selected  system.  The  "user"  and  "supporting  commands"  participates  in 
the  Development  Test  and  Evaluation  (DT  &  E)  and  Initial  Operational 
Test  and  Evaluation  (ICT  &  E).  Tne  contractor  negotiates  for  production 
during  the  testing  process,  and  configuration  audits  (FCA  and  PCA)  are 
accomplished  subsequent  to  finalizing  the  system  configuration.  After 
this,  any  change  in  the  system  is  rigidly  controlled  and  must  follow  the 
formal  Engineering  Change  Proposal  (ECP)  route.  The  results  of  the 
Development  Phase  are  presented  to  DSARC  at  milestone  III  for  review. 

If  approval  is  granted  and  Office  of  the  Secretary  of  Defense  (OSD) 
funding  procured,  the  program  enters  production. 

In  the  Production  Phase,  the  system  is  produced  by  the  contractors 
and  logistic  support  is  procured.  This  by  far  is  the  most  costly  and 
time  consuming  phase  up  to  this  point. 

The  completed  system  is  turned  over  to  the  user  in  the  Deployment 
Phase  by  the  Systems  Manager  ( SH )  in  Logistics  Command  (AFLC).  There 
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the  system  is  utilized  and  maintained  until  its  retirement.  Figure  1 
shows  the  major  phases  in  the  idealized  system  life  cycle  and  the  approx¬ 
imate  time  for  completion  of  each  phase. 

2.2  EW  Program  Complications 

The  process  just  described  for  EW  retrofit  of  an  aircraft  is  seldom 
followed  exactly  because  of  a  number  of  complex  factors  pertinent  to 
electronic  warfare.  There  are  seven  basic  reasons  for  EW  retrofit 
difficulties. 

1 .  Electronic  Warfare  is  a  highly  technological,  expensive,  and 
specialized  business.  EW  equipment  requires  extensive  dedicated  research 
and  development  capabilities  that  only  a  limited  number  of  industrial 
contractors  have  established.  The  risks  in  developing  and  retrofitting 
these  sophisticated  and  specialized  systems  are  high,  and  the  spin-offs 
to  commercial  application  are  severely  limited. 

2.  There  is  insufficient  communication  between  all  stakeholders 
at  all  phases  of  the  system  cycle.  There  is  a  lack  of  effective  inter¬ 
change  of  information  between  groups  G-1,  G-2,  and  G-3  in  the  Conceptual 
Phase  of  system  development.  An  exception  to  this  lack  of  communication 
occasionally  exists  between  the  upper  level  DMs  in  groups  G-1  and  G-2 
when  politically  sensitive  equipment  is  involved.  The  general  leck  of 
communication  makes  any  kind  of  long  range  planning  for  the  system  retro¬ 
fit  very  difficult.  This  lack  of  communication  prevents  the  cost  and 
performance  people  from  coming  to  early  agreement  which  generally  means 
time  delays  at  later  phases  in  the  system  cycle. 

3.  The  decision  making  structure  is  multilevel  and  semidefined. 

The  decision  makers  (DMs)  and  their  advisors  in  G-1  and  G-3  groups  are 
defined  but  arranged  in  multilevels  which  makes  it  difficult  for 
amalgamation  of  objectives  at  these  various  levels.  The  DMs  and  their 
advisors  in  G-2  group  are  also  arranged  in  multilevels  but  are  not 
clearly  defined.  This  means  that  certain  gerents  can  participate  in 
varying  degrees  in  their  decision  making  role  depending  on  factors  such 
as  the  political  atmosphere.  This  makes  it  particularly  difficult  to 
account  for  some  DH’s  interactions. 
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4.  Government  policy  makers  do  not  operate  in  sufficient  isolation 
from  private  industry.  The  government  policy  advisors  in  G-1  and  G-2 
groups  perpetuate  a  long  standing  amenitable  relationship  between  them¬ 
selves  and  EW  industries.  While  this  relationship  can  be  beneficial  to 
the  government  in  certain  aspects  of  contract  negotiations,  it  can  cause 
difficulties  such  as  the  fact  that  system  deficiencies  (and  their  ameli¬ 
oration)  are  often  pointed  out  by  the  system  builder  or  contractor  in¬ 
stead  of  the  intelligence  community. 

5.  Lons  range  government  policy  is  difficult  to  forecast.  The  com¬ 
plex  issues  that  affect  foreign  policy  coupled  with  a  bureaucracy  that 
administers  it,  makes  it  particularly  difficult  to  estimate  accurately 
what  the  U.S.  foreign  policy  will  be  for  other  than  very  short  planning 
horizons . 

6.  The  current  funding  directives  (0MBC-109)  encourage  (and 
occasionally  specify)  dual-contractor  development  procedure  for  newly 
designed  equipment.  This  is  done  as  a  way  of  insuring  commonality  in 
technology,  and  preventing  a  sole  source  supplier  of  replacement  parts. 
Unfortunately  this  practice  of  carrying  two  contractors  throughout  the 
program  also  tends  to  cause  funding  and  scheduling  problems. 

7-  The  contractor  and  retrofit  program  are  often  given  flexibility 
with  respect  to  cost  and  schedule  commitments.  The  primary  reason  a  pro¬ 
gram  gets  limited  in  scope,  indefinitely  delayed,  or  cancelled  is  that 
it  has  been  surpassed  on  the  priority  list  (and  another  program  took 
its  funds).  The  logical  reasons  for  the  above  actions  (lack  of  per¬ 
formance  in  the  system,  cost  and  schedule  overruns)  are  not  considered 
as  prominently. 

These  factors  presented  above  make  the  normal  EW  retrofit  procedure 
(Section  2.1)  difficult  to  implement.  These  items  point  out  the  need 
for  a  comprehensive  approach  to  the  EWARD  such  as  supplied  by  MOOT  or 
MAUT  through  the  systems  engineering  methodology.  These  multiple  cri¬ 
teria  approaches  allow  the  incorporation  of  a  set  of  salient  attributes 
in  a  way  that  allows  one  to  address  the  requirements  by  individually  con¬ 
sidering  factors  which  are  affected  by  the  impediments  discussed  pre¬ 
viously.  This  flexibility  is  of  significant  value  in  a  large-scale 
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effort  like  EWARD.  In  EWARD,  the  need  exists  for  an  adequate  set  of 
criteria  which  can  be  utilized  in  the  evaluation  of  alternatives.  The 
development  and  subsequent  incorporation  of  these  criteria  into  the 
difficulties  cited  produce  a  cost  effective  product  that  will  meet  the 
needs  of  the  users. 

3.  Structure  of  the  EWARD  Decision  Situation 

In  order  to  set  the  stage  for  the  application  of  techniques  from 
both  MOOT  and  MAUT,  a  common  pre-analysis  effort  covering  the  problem 
definition,  value  system  design,  and  system  synthesis  phases  was  per¬ 
formed  in  order  to  identify  and  relate  the  factors  of  the  U.S.  Air  Force 
EWARD  structure.  Sections  1  and  2  basically  describe  the  pertinent 
stakeholders.  The  G-l  group  (Operations  and  Intelligence)  is  responsible 
to  point  out  deficiencies  and  coordinate  requirements  so  the  retrofitted 
system  is  operationally  satisfactory.  This  group  includes  the  eventual 
users  of  a  retrofitted  system.  The  G-2  group  (Government  policy)  is 
the  group  that  coordinates  the  systems  impact  on  defense  capability  and 
foreign  policy.  This  group  also  constrains  the  program  with  respect  to 
budgetary  considerations.  The  G-3  group  (Technical  development  and 
assessment)  defines  the  system  configuration,  and  carries  out  and  mai- 
ages  the  research,  development  and  production  of  the  retrofit  system. 
While  other  stakeholders  are  involved  in  EWARD,  their  interactions  are 
extremely  difficult  if  not  impossible  to  define,  assess  or  forecast. 

The  general  needs  of  an  EWARD  are  defined  in  the  SOW  and  MENS  docu¬ 
ments  which  delineate  currently  existing  deficiencies.  Historically, 
specific  needs  of  the  new  system  are  described  as  threats  to  be  countered 
in  terms  of  requirements  and  EW  techniques.  The  aircraft  which  will  be 
retrofitted  is  often  an  obvious  choice  because  of  the  performance  re¬ 
quirements,  operational  situation,  and  current  aircraft  inventory  supply. 
The  number  of  these  special  purpose  aircraft  required  for  the  specific 
mission  is  often  specified  and  considered  fixed  in  the  early  phases  of 
the  DOD  equipment  acquisition  cycle.  Therefore,  the  aircraft  upon  which 
the  retrofit  will  be  applied  as  well  as  the  fleet  size  is  hypothesized 
as  determined ,  and  its  selection  is  not  to  be  discussed  in  this 
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pre-analysis  phase. 

The  possible  options  to  ameliorate  current  deficiencies  are  listed 
in  the  Conceptual  and  Validation  Phases  in  terms  of  passive  procedures, 
transmitting  and  receiving  system  techniques,  and  active  and  passive 
expendables  disbursement.  The  major  constraints  for  the  retrofit  system 
are  size,  weight ,  power,  and  cooling  restrictions  (determined  by  the 
aircraft  itself) ,  funds  available  (a  function  of  the  deficiency  priority 
and  other  factors ) ,  and  time  until  deployment  ( a  function  of  bureau¬ 
cratic  scheduling,  and  research  and  development  -  R  and  D  status). 

A  subset  of  the  objectives  of  the  USAF  is  listed  in  Table  2.  These 
upper  level  goals  are  arranged  in  the  hierarchial  intent  structure  of 
Figure  5.  The  main  objectives  of  the  EW  task  which  were  constructed  as 
a  result  of  interaction  with  the  stakeholders  are  listed  in  Table  3.  The 
lower  level  objectives  of  the  EW  task  in  their  hierarchial  order  are 
shown  in  Figure  6.  It  is  this  latter  set  of  objectives  that  were  ex¬ 
ploited  in  the  solution  of  the  EWARD.  The  measures  by  which  attainment 
of  the  objectives  is  discerned  (attributes)  are  shown  in  Figure  7  and 
listed  in  Table  4  for  the  lower  level  objectives.  This  set  of  attributes 
was  used  in  the  evaluation  process  for  the  alternatives  in  this  EWARD 
effort. 

While  the  objectives  and  their  measures  of  attainment  at  the  lower 
levels  may  seem  self-explanatory,  a  brief  description  is  provided  to 
cover  some  of  the  aspects  of  the  EWARD. 

a.  The  aircraft  weight  attribute  is  a  measure  of  the  added  weight 
(Kg)  due  to  the  total  EW  system  plus  a  penalty  figure  (also  in  Kg)  which 
accounts  for  any  modifications  to  the  fuselage  caused  by  the  EW  system 
which  would  increase  drag  such  as  external  antennas,  external  components, 
external  wing  pods,  air  induction  cowlings  for  cooling,  etc.  The  drag 
caused  to  the  aircraft  fuselage  by  a  system  is  converted  to  equivalent 
penalty  weight  as  a  way  of  accurately  quantifying  the  impact  of  a  specific 
system  on  the  aircraft  performance  without  double  counting  with  respect 

to  another  attribute. 

3 

b.  The  volume  attribute  (meters  )  is  a  measure  of  internal  volume 
occupied  by  the  Eli?  system.  The  available  volume  for  EW  equipment  is 


Table  2 . 


Subset  of  Objectives  of  the  USAF 


*  To  Support  the  National  Objectives  and  Policies  of  the 
United  States 

*  To  Maintain  a  Strong  Air  Force  Capable  of  Multiple- 
levels  of  Response 

*  To  Provide  Forces  Capable  of  a  Strategic  Response 

*  To  Provide  Forces  Capable  of  a  Tactical  Response 

*  To  Train  and  Maintain  Forces  to  Support  USAF  Objectives 

*  To  Perform  the  Reconnaissance  Tasks  Assigned 

*  To  Perform  the  Electronic  Warfare  Task  Assigned 

*  To  Provide  a  Military  Airlift  Capability 

*  To  Provide  Support  for  Ground  and  Sea  Forces 
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Intent  Structure  of  USAF  Objectives 


Table  3 


Electronic  Warfare  Objectives 

*  To  Perform  the  Electronic  Warfare  Task  Assigned 

*  To  Provide  for  Electronic  Support  Measures  (ESM) 

*  To  Provide  for  Electronic  Counter  Measures  (ECM) 

*  To  Provide  for  Counter-Counter  Measures  (BCCM) 

*  To  Maximize  Aerodynamic  Performance  of  EW  Aircraft 

*  To  Minimize  Life  Cycle  Cost  of  the  EW  System 

*  To  Maximize  Electronic  Warfare  Performance 
of  the  Retrofit  System 

*  To  Maximize  National  Policy  Satisfaction  Through 
the  EW  System 
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Figure  6.  Hierarchy  of  Objectives  of  the  EW  Selection  Process 


Figure  7.  Attribute  Template  For  EWARD 


Table  A 


Lower  Level  Attribute  Limits 


Attribute 


Greatest  Level 


Lowest  Level 


X.j  Aerodynamic 
performance 

X,_  EW  system  weight 

I  Cl 

X1b  EW  system  volume 
X]c  Erf  system  power 


A. 5  x  TO3  kg 
A.  10  m3 
105.0  KVA 


5.C  x  102  kg 
1.5  m3 
A5.0  KVA 


X~  EW  system  life 
d  cycle  cost 


2.0  x  109  ($) 


1.0  x  104*  it 


Xp  Electronic  warfare 
performance 


X-,  Aircrew  effectiveness 
3a 

1.0 

^normalized 

scale) 

0.0 

X~  Number  of  threat 

D  types  degraded 

30.0 

5.0 

X3  Number  of  threat 
types  defeated 

30.0 

C.O 

Degree  of  policy 

1.0 

'.normalized 

0.0 

satisfaction  scale) 
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usually  limited  because  of  competition  from  other  needed  avionics 
equipment. 

c.  The  power  attribute  (KVARS)  is  a  measure  of  the  peak  electrical 
power  required  to  operate  the  EW  equipment  (including  auxiliary  cooling; . 

d.  The  air  crew  performance  attribute  (direct  performance  measure) 
measures  the  degree  of  dedicated  service  that  the  EW  system  demands  out 
of  the  crew  for  successful  operation  (some  manual/automatic  systems  may 
require  more  crew  operations  than  is  physically  possible).  Values  of 
this  attribute  can  be  obtained  by  simulation  of  the  cybernetic  candidate 
system.  A  normalized  scale  (limits  of  0.0  to  1.0)  was  used  to  score  the 
various  alternative  systems.  The  minimum  score  of  0.0  represents  the 
case  where  the  air  crew  was  unable  to  perform  the  tasks  required  by  an 
alternative  system  in  a  simulated  combat  environment.  The  maximum 
score  of  1.0  represents  the  case  where  the  air  crew  was  able  to  perform 
all  tasks  required  for  completely  successful  operation  of  the  alternative 
system  in  a  simulated  combat  environment. 

e.  The  threats  affected  attribute  (no.  of  threats  degraded)  is  a 
measure  of  the  ability  of  the  EW  system  to  affect  individual  threat 
types  in  a  dense  environment  (currently  operational  and  forecast  threats 
validated  by  a  threat  group ) . 

f.  The  threats  defeated  attribute  mo.  of  threats  defeated)  mea¬ 
sures  the  number  of  specific  threat  types  defeated  which  are  made  inop¬ 
erable  by  the  EW  system. 

g.  The  cost  attribute  (dollars)  is  a  measure  of  the  life  cycle 
costs  of  the  EW  system  to  include  R  and  D,  production,  and  maintenance 
of  the  expected  life  of  the  system.  This  total  life  cycle  cost  approach 
is  applied  with  increasing  frequency  to  D0D  equipment  acquisition  pro¬ 
grams. 

h.  The  policy  satisfaction  attribute  (direct  effectiveness  measure 
of  directives,  policies,  and  requirements  satisfied)  is  a  measure  of  the 
degree  to  which  the  EW  retrofitted  aircraft  satisfies  forecast  govern¬ 
ment  policies  for  the  production  decision  point  particularly  of  the  C—  2 
group.  Policy  satisfaction  includes  concepts  influencing  candidate 
EW  system  political  attractiveness  at  a  point  in  time  in  the  future  (the 


production  decision  point).  This  then  requires  one  to  forecast  the 
political  mood  and  subsequent  government  policy.  Some  of  the  elements 
which  are  included  in  this  factor  are:  attitude  toward  U.S.  defense 
posture  by  the  administration  and  congress,  need  for  foreign  arms  sales, 
treaty  and  alliance  commitments,  budgetary  priorities  and  amounts  of 
federal  spending,  military  lobby,  time  to  production  of  EW  system,  avail¬ 
ability  of  manufacturers  to  meet  the  requirement  for  dual  source  suppli¬ 
ers  of  critical  parts  of  a  system,  employment  and  unemployment  effects 
on  certain  contractors,  granting  of  subcontracts  of  a  system  for  the 
sake  of  keeping  a  base  of  companies  involved  in  defense  oriented  work, 
etc.  None  of  the  DMs  interviewed  were  able  to  quantify  all  of  the  above 
elements,  so  an  attempt  at  aggregation  of  the  elements  met  with  some 
success.  The  DMs  were  able  to  express  the  fact  that  as  the  time  until 
production  increased,  the  probability  of  accurately  forecasting  the 
political  policies  which  would  need  to  be  satisfied  decreased  exponen¬ 
tially  . 

All  DMs  agreed  after  discussing  that  this  factor  needs  inclusion 

even  if  it  is  very  difficult  to  quantify  accurately.  This  concensus 

among  Diis  and  advisors  for  including  policy  satisfaction  as  one  of  the 
/ 

objectives  justifies  the  use  of  a  MCDT  approach  such  as  MOO'1’  or  MAUT. 

A  normalized  scale  (limits  0.0  to  1.0)  was  used  to  score  the  alterna¬ 
tives  with  respect  to  policy  satisfaction.  The  minimum  score  of  0.0 
represents  the  case  where  it  is  estimated  that  an  alternative  will  not 
satisfy  any  of  the  policies  in  effect  at  the  production  decision  point. 

The  maximum  score  of  1.0  represents  the  case  where  it  is  estimated  that 
an  alternative  will  satisfy  all  policies  in  effect  at  the  production 
decision  point.  The  DMs  and  advisors  estimated  policy  satisfaction  scores 
for  the  candidate  systems.  A  maximum  time  for  initiation  of  production 
was  established  at  eight  years  so  that  the  values  could  be  obtained  for 
various  candidate  systems  with  certain  characteristics. 

It  is  noted  that  no  comprehensive  set  of  attributes  (as  complete  as 
the  set  just  presented)  is  now  used  in  the  initial  design  stages  of  the 
current  EVJARD  efforts.  The  DMs  and  advisors  interviewed  in  this  effort 
agreed  that  the  above  set  of  attributes  covers  the  salient  considerations 
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of  an  EW  retrofit  program,  and  that  the  goodness  of  a  specific  system 
could  be  adequately  evaluated  using  these  attributes. 

The  alternative  policies  that  achieve  the  objectives  with  respect 
to  an  EW  task  are  the  selection  and  retrofit  of  EW  equipment  into  the 
designated  aircraft.  A  specific  action  is  the  selection  and  retrofit  of 
a  specific  EW  system  with  the  designated  number  and  type  of  the  primary 
components  (including  associated  airborne  and  ground  equipment)  as 
indicators  of  this  activity  (e.g.  system  a  has  16  transmitters,  3  re¬ 
ceivers,  1  processor  and  A  expendables).  Each  separate  system  designated 
has  characteristics  measurable  by  the  lower  level  attributes  mentioned 
earlier  (e.g.  systems  a  could  have  weight  b,  life  cycle  cost  r,  degrade 
h  threats ,  etc . ) .  The  attribute  values  and  characteristics  of  each 
specific  system  in  competition  for  selection  can  have  deterministic  and 
probabilistic  values  (e.g.  R  and  D  may  not  yet  be  completed  and  the 
weight,  cost,  and  number  of  threats  covered  are  not  known  with  certainty, 
but  utilizing  data  and  estimates,  distributions  covering  the  stochastic 
elements  were  obtained ) . 

A  hypothetical  deficiency  designation  and  set  of  possible  EW 
systems  to  ameliorate  this  vulnerability  will  now  be  described.  A  hypo¬ 
thetical  situation  is  selected  because  the  security  classification  per¬ 
taining  to  past  and  ongoing  EW  systems  would  prevent  the  publication  cf 
these  results  in  unclassified  texts  thereby  prohibiting  a  general  useful¬ 
ness  which  is  the  purpose  of  this  research.  While  no  information  is 
compromised,  the  hypothetical  situation  characteristics  are  relevant  to 
actual  EW  systems  sc  that  DHs  and  advisors  could  realistically  take  part 
in  the  EWARD  effort  (in  the  opinion  of  the  DMs  and  advisors  interviewed , 
the  hypothetical  situation  mimicked  reality  to  a  high  degree ) .  Tne 
hypothetical  situation  was  also  used  to  produce  a  general  solution  pro¬ 
cedure  that  may  be  situation  specific,  but  not  equipment  specific  (i.e., 
the  modelling  done  was  intended  to  be  general  in  nature  -  applicable  to 
any  EW  system  of  the  present  and  near  future  -  and  not  intended  to  con¬ 
centrate  only  on  modelling  specific  pieces  of  equipment  for  a  single 
solution ) . 

Assume  the  deficiency  statements  (i-EiiS  and  SOU ;  designated 


primary  threats  and  II"  secondary  threats  (specific  active  -  radar,  laser, 
etc.,  and  passive  -  infra-red,  electro-optical,  etc.;  which  are  sources 
of  intelligence  for  enemy  fire  control  systems  and  armaments  (airborne 
interceptor,  anti-aircraft  artillery,  surf ace-to-air  missiles ,  etc.;.  A 
set  of  El-/  system  components  both  developed  and  proposed  to  counter  these 
N  threats  (N  =  N'  +  N")  is  available  from  governmental  and  industrial 
sources.  For  our  hypothetical  situation,  the  attribute  limits  for  the 
possible  system  components  are  shown  in  Table  4. 

A  set  of  alternative  proposed  systems  was  assembled  which  are 
representative  and  typical  of  the  spectrum  of  choices  which  confront  the 
analysts  and  policy  makers  in  the  Conceptual  Phase  of  EKARD.  This  list 
of  alternative  EW  system  configurations  shown  in  Table  5  is  hypothetical¬ 
ly  generated  as  a  response  of  the  RFP  in  the  initial  stage  of  the  Con¬ 
ceptual  Phase.  These  alternative  configurations  (with  expected  attribute 
levels  and  associated  normal  probability  density  functions  were  con¬ 
structed  from  USAF  supplied  in-house  and  contractor  empirical  data,  and 
supplemented  by  expert  opinion  when  incomplete  data  was  available  li.e., 
for  the  levels  of  the  policy  satisfaction  attribute,  the  opinions  of  Dlls 
and  advisors  from  G— 1 ,  G-2,  and  G-3  were  used  to  estimate  levels  of  at¬ 
tainment  for  the  alternatives  and  accompanying  probability  density  func¬ 
tions,  since  little  or  no  data  was  available  for  this  task).  The 
probability  density  functions  (pdf)  represent  the  risk  of  realizing  a 
system  (in  the  Production  Phase)  which  has  the  attribute  levels  listed. 
Figure  8  shows  an  example  of  retrofit  system  weight  and  its  accompanying 
probability  density  function  for  alternative  1 .  The  alternatives  are 
described  in  Table  5  by  a  dominant  characteristic  (i.e.,  high  cost  alter¬ 
native,  high  electronic  warfare  performance  alternative,  etc.).  The 
probability  density  functions  for  the  alternatives  in  terms  of  standard 
deviation  of  their  attribute  levels  is  listed  in  Table  6.  These  density 
functions  are  utilized  later  in  the  impact  assessment  and  decision  making 

S  i/SpS  • 

In  order  oo  establish  a  basis  upon  ’which  to  choose  an  appropriate 
MCDT  approach,  the  attributes  were  investigated  with  respect  tc  prefer¬ 
ential  independence.  Selected  Dl-is  and  advisors  from  each  group  'were 


Table  5 


Alternative  Retrofit  System 
Configurations  and  Characteristics 


Alternative  Descriptive  Phase 

1  (a^)  Compromise  1  (average) 


2  (a2)  High  cost,  high  reliability 

3  (a-j)  High  electronic  warfare  performance 

4  (a^)  High  aircraft  performance 

5  (a^)  Low  electronic  warfare  performance 

6  (ag)  Low  aircraft  performance 

7  (a^,)  Low  cost 

8  (ag)  Compromise  2  (average)  | 

I 


Figure  B.  probability  Distribution  Of  EW  System  Weight  For  Alternative 


Alternative  Configuration 
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interviewed  to  examine  how  these  gerents  trade-off  levels  of  the  attri¬ 
butes.  Using  standard  assessment  techniques,  second  order  preference 
independence  was  explored  (Keeney  and  Raiffa,  1976;  Keefer,  1976; 

Keeney,-  1974).  The  major  attributes  ( X ^ ,  X^,  X^,  X^)  were  found  to  be 
preferentially  independent  (PI!  and  the  components  of  and  XM  were  also 
found  to  be  PI  (an  example  of  the  PI  assessment  for  Group  3  is  shown  in 
Figure  9).  The  set  (X.,T.)  is  preferentially  independent  of  Xjrr  [set 

V  ^  w 

levels  of  all  other  attributes  except  X.  and  X^j  if  preferences  for  con¬ 
sequences  differing  only  in  the  value  of  X..  and  X  ^  do  not  depend  or.  the 
fixed  value  of  Xj^. 

An  appropriate  point  for  the  remainder  of  the  EWARD  to  take  place 
is  between  the  Conceptual  Phase  authorization  and  Program  Management  Plan 
preparation.  Its  results  should  be  used  to  aid  in  judging  the  contractor 
competition  or  sole  source  performance,  and  also  used  as  inputs  to  the 
final  RFP  after  contractor  selection  before  production.  The  information 
needed  to  perform  the  EWARD  as  presented  in  this  chapter  is  present  in 
the  Conceptual  Phase. 

Now  that  a  basic  pre-analysis  has  been  conducted  for  the  EWARD 
situation  presented,  the  remaining  steps  of  modelling  and  system  analysis 
optimization  and  decision  making  are  accomplished  in  Section  4  using  a 
combined  MOOT/MAUT  approach. 


4.  MOOT/MAUT  Approach  to  EWARD 

Factors  in  EWARD  such  as  the  lack  of  an  adequate  scalar  performance 
measure,  the  high  level  of  complexity,  and  the  difficulties  cited  which 
hamper  an  efficient  acquisition  process,  make  this  situation  a  likely 
candidate  for  a  comprehensive  multiple  criteria  approach  like  the  com¬ 
bined  MOOT/MAUT  process  applied  through  the  systems  engineering  method¬ 
ology. 

The  EWARD  situation  contains  certain  characteristics  such  as  a  set 
of  attributes  which  the  DMs  and  advisors  have  established  as  prefer¬ 
entially  independent  and  an  indication  by  the  DMs  and  advisors  that  they 
would  prefer  to  reduce  the  number  of  alternatives  before  comparing  and 
ranking  the  remaining  alternatives.  The  DMs  and  advisors  traditionally 


Electronic  Warfare  Performance  (X^) 

(  X]_  X  were  consistently  traded  off  according  to  tr 
curves  above  for  various  joint  levels  of  X„  and  X  ). 

C  A 

Figure  9-  Preference  Independence  Of  Attributes 


attempt  to  eliminate  some  alternatives  before  examining  the  remaining  in 
more  depth,  and  were  comfortable  working  in  this  mode.  These  character¬ 
istics  in  EWARD  suggest  that  the  combined  MOOT/MAUT  process  is  appro¬ 
priate  for  modelling  and  resolving  this  decision  situation.  The  MOOT/ 
MAUT  process  as  applied  to  EWARD  will  follow  the  basic  algorithm  out¬ 
lined  in  Figure  2  (Chapter  4}  with  some  minor  variation  due  to  the  fact 
that  there  are  groups  of  DMs  involved.  The  main  steps  are:  a)  conduct 
a  pre-analysis  phase,  b)  eliminate  the  inferior  alternatives  through  an 
optimization  of  process  and  an  elimination  by  aspects  exercise,  c'  elici 
the  preference  structure  of  the  DMs  to  subsequently  develop  a  scalar 
choice  function  which  ranks  the  remaining  alternatives  to  identify  the 
optimal  policy,  d)  conduct  a  sensitivity  analysis  and  validation  exer¬ 
cise,  e)  prepare  an  action  plan.  The  pre-analysis  of  Section  3  will  be 
used  as  the  basis  for  modelling,  optimization,  and  decision  making. 

In  response  to  the  development  of  a  MBITS,  retrofit  system  config¬ 
urations  from  the  contractors  become  available  which  represent  the 
alternative  actions.  All  of  the  proposed  alternative  systems  are  feas¬ 
ible  alternatives,  and  no  preliminary  scanning  is  required  in  SWARD  at 
this  point  in  the  effort  to  eliminate  the  unacceptable  alternatives. 
Because  a  large  amount  of  engineering  design  is  required  for  interfacing 
a  complete  retrofit  system,  information  is  available  at  this  point 
(Conceptual  Phase)  which  basically  establishes  the  impacts  cf  each  alter 
native  action  (implementing  an  alternative  retrofit  system).  Therefore, 
no  tuning  or  refining  of  the  alternative  systems  is  required  in  the 
Conceptual  Phase  unless  none  of  the  alternative  actions  are  viable  solu¬ 
tions  to  the  deficiencies  cited  in  the  >ENS .  The  criteria  established 
in  the  pre-analysis  phase  was  used  as  the  basis  for  developing  the 
attributes  (Table  1)  used  in  this  effort. 

The  identification  of  alternatives  which  are  superior  with  respect 
to  the  attributes  developed  in  the  pre-analysis  phase  is  undertaken 
with  the  formation  of  the  I.'DSS.  In  order  to  utilize  the  data  concerning 
the  attributes  (which  include  risk  information),  the  technique  of 
stochastic  dominance  was  used  to  indicate  which  of  the  alternatives  was 
dominated.  The  eight  alternatives  were  compared  to  each  other  with 


respect  to  the  stochastic  dominance  of  attribute  values  tc  see  if  any 
alternatives  were  dominated  with  respect  to  all  attributes.  The  cumula¬ 
tive  probability  distribution  (CDF)  for  attribute  values  for  each  of  the 
alternatives  with  respect  to  system  weight  lx.  )  is  shown  in  Figure  10. 

I  a 

When  the  area  under  the  CDF  for  an  alternative  (A^)  is  less  than  the  area 

under  the  CDF  of  another  alternative  (A^)  (for  a  specified  attribute), 

A.  is  said  to  dominate  A-  in  the  sense  of  stochastic  dominance  for  that 
■**  J 

attribute.  A^  is  said  to  dominate  Aj  if  stochastic  dominance  is  present 
for  all  attributes  for  A-  with  respect  to  A_. .  Stochastic  dominance  re- 

^  J 

lationships  were  established  for  all  alternatives  on  a  pairwise  basis 
for  all  attributes  with  the  results  that  only  one  alternative  system 
(alternative  6)  is  dominated.  The  large  KDSS  was  expected  since  there 
are  a  number  of  conflicting  objectives.  In  the  interest  of  reducing  the 
number  of  alternatives  in  the  NDSS  further,  to  bring  the  i.'DSS  membership 
to  a  number  acceptable  by  the  DMs,  an  elimination  by  aspects  exercise 
was  conducted.  Each  group  was  asked  to  come  up  with  a  set  of  realistic 
(from  their  specific  vantage  point)  minimum  acceptable  attainment  levels 
that  the  alternatives  would  have  to  pass  to  be  considered  in  the  ncn- 
dominated  solution  set.  These  levels  are  shown  for  all  three  groups 
in  Table  7.  In  this  elimination  by  aspects  exercise,  the  analyst  must 
ensure  that  all  attainment  levels  of  the  attributes  which  are  exceeded 
by  an  alternative  reflect  an  essential  shortcoming  in  the  EVJAP.D .  This 
elimination  by  aspects  eliminated  three  alternatives  (alternatives  2,  3, 
and  5)  each  of  whose  attribute  values  violated  many  minimum  attainment 
levels  of  the  stakeholder  groups.  There  were  then  four  alternatives 
comprising  the  NDSS  (alternatives  1,  4,  7,  and  8). 

How  in  order  to  select  the  best  alternative  system  from  the  re¬ 
duced  NDSS,  and  to  facilitate  operating  with  risk  in  the  decision  pro¬ 
cess,  a  MAUT  technique  was  utilized  for  the  ranking  of  alternative  sys¬ 
tems/decision  making  phase.  The  characteristics  of  the  situation  such 
as  an  available  set  of  attributes,  the  availability  of  the  directly 
assessed  preference  structure  of  the  Dlls  and  advisors,  and  the  availa¬ 
bility  of  probabilistic  information  concerning  the  attribute  values  for 
the  alternatives,  suggest  the  use  of  Multiattribute  Decision  Analysis  as 
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the  MAUT  technique. 


Hultiattribute  Decision  Analysis  l  I'iADA  )  has  been  a  very  popular 
technique  for  use  in  decision  situations  with  multiple  attributes.  To 
use  this  requires  the  identification  of  subjective  probability  for  un¬ 
certain  consequences,  and  elicitation  of  DM ' s  preferences  over  these 
attributes  expressible  in  cardinal  utility  functions  (Keeney  and  Raiffa, 
1976;  Keeney  and  Wood,  1977;  5rown,  Kahr,  and  Petersen,  1974;  Barclay, 
et  al.,  1977;  Huber,  1977;  Sage,  1977;  Keeney  and  Kirkwood,  1977  .  7ne 
added  complication  of  multiple  DM s  and  advisors  at  various  levels  re¬ 


quires  the  consideration  of  group  amalgamation  of  preferences  (Banker 
and  Gupta,  1 97S ;  Keeney  and  Kirkwood,  1375;  Wakayama,  et  al.,  1979.. 

The  basic  decision  model  is  illustrated  on  Figure  1 1 .  The  decision 
space  a  A  is  made  up  of  individual  actions  of  the  reduced  I.'DSS 
a^  =  incorporating  set  i  ( alternative  ij  of  equipment 
as  the  retrofit  system,  i=1,2,,,,.n 
i.e.,  set  i  includes  a  combination  of  EW  equipment  with  associated 
attribute  values  for  X^,  i  =  1,2, 3, 4  as  discussed  in  Section  3.  For 
example,  selecting  (implementing  alternative  1!  causes  the  retrofit 

of  a  system  with  components  which  collectively  cive  the  attribute  levels 
Z11  ..  Z11  ..  Z11  ..  z11. 


J11 


.e.,  x1 


,x. 


,x3 


,x, 

7  M- 


with  probability 


p.  where  p.  is  the 
’■“-■ii  z  1 1  z  pii 

combined  probability  of  =  x^  -  Xg  ,  x^  =  x^  “,xA  =  x 


H  A 

The  probability  of  the  system  configuration  under  alternative  1  being  at 
other  collective  attribute  levels  or  output  states  is  ps  ’where  i  = 

1,2,, and  l  ?i=1.  These  probabilities  express  the  likelihood  of  the 
retrofit  system  giving  the  estimated  values  cf  the  attributes  ir.  actual 
operation  on  the  aircraft.  In  order  to  incorporate  the  risk  cf  system 
implementation  into  the  HADA  format,  output  configurations  other  than 
the  expected  configuration  were  constructed  from  the  data  and  combined 
with  probabilities  of  realization  from  Monte  Carlo  simulations.  In  order 
to  keep  the  problem  in  a  framework  that  current  EVJAED  stakeholders  are 
familiar  with,  only  three  resulting  configurations  were  used  for  each 
alternative  configuration.  Tne  characteristics  of  these  three  config¬ 
urations  a  degraded,  expected,  and  improved  version;  of  each  alternative 
system  is  shown  in  Taole  6.  Because  of  the  gaussian  density  function 
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forms  for  all  candidate  systems,  three  standard  probabilities  were  used 
for  the  three  approximate  outputs  of  each  candidate  system  (p  =  .63  for 
the  expected  configuration  state,  p  r  .16  for  the  improved  configuration 
state,  and  p  =  .16  for  the  degraded  configuration  state).  Figure  12 
illustrates  the  rationale  behind  this  approximation.  This  discretization 
of  the  probabilistic  data  means  that  m  =  3  and  n  =  8  for  the  EWART  formu¬ 
lation  of  MADA  posed  in  Figure  1 1 . 

This  MADA  technique  was  modelled  for  application  chronologically  in 
the  Conceptual  Phase  of  EWARD  so  as  to  be  able  to  incorporate  available 
information  from  all  groups  at  an  early  phase,  and  to  specify  the  retro¬ 
fit  configuration  and  evaluate  the  resulting  system.  Care  was  taken  to 
separate  the  subjective  probability  encoding  and  utility  assessments  so 
as  to  prevent  any  interaction  effects  such  as  bias  and  double  weighting 
of  certain  events  and  outputs. 

The  first  items  addressed  were  the  functional  relationships  between 
attributes  and  the  form  of  the  multiattribute  utility  function  which 
would  measure  an  aggregated  felicity  for  each  alternative  retrofit  sys¬ 
tem.  Since  preferential  independence  among  attributes  was  established 
in  the  pre-analysis  phase,  first  order  utility  independence  (UI;  was 
next  examined.  is  UI  of  Xj  tall  attributes  other  than  X..  )  if 
preferences  for  risky  choices  {lotteries)  over  X^  with  the  value  cf  XT- 
held  fixed  do  not  depend  on  the  fixed  value  of  X-.  Using  standard  MrfJT 
assessment  techniques  (Keeney  and  Raiffa,  1976),  it  was  found  that 
was  utility  independent  and  because  (X^,Xj)  is  PI,  i  =  2,3,4,  using 
Theorem  6.2  (Keeney  and  Raiffa,  1976)  it  can  be  concluded  that  the  major 
attributes  are  mutually  UI  (MU!) .  The  components  of  each  cf  X^  aid  X^ 
were  also  found  to  be  MUI.  next ,  the  attributes  were  examined  with 
respect  to  Fishbum  Marginal ity  (Fishburn,  1967;  Winterfeldt  aid 
Fischer,  1973)  as  shown  in  Figure  13.  It  was  soon  pointed  out  by  the 
interviewees  that  additive  independence  did  not  hold.  Therefore  invoking 
the  fact  that  the  attributes  are  MUI  and  Theorem  6.1  of  Keeney  and 
Raiffa  (1976),  it  is  concluded  that  a  multiplicative  form  of  multi¬ 
attribute  utility  function  is  appropriate  for  this  application.  The 
multiplicative  utility  function  has  the  general  form 


The  additive  utility  function  requires  the  individual 
utility  function  (u^(x^))  to  be  additive  independent. 
Additive  independence  occurs  when  preferences  over  lotteries 
on  outcomes  (described  in  terms  of  the  attributes)  depend 
only  on  marginal  probability  density  functions  of  the 
attributes,  f(x^),  and  not  on  the  joint  density  functions 
of  the  attributes  f(x)  =  f(x^,x2, , ,x  ) .  That  is,  the  two 
lotteries  shown  below  must  be  equally  preferred.  This 
condition  must  hold  for  all  combinations  of  the  attributes 
(xlfx2, , ,xn) ;  i.e.  if  n  =  4,  this  condition  must  hold  for 
all  possible  subsets  of  (x^ ,x2,x^ ,x^) . 

Figure  13-  Check  For  Marginal  Equivalence  (Marginality ) 
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1  +  Ku  =  n  (i  +  KJCu. )  ; i ) 

i  ~* 

where  u  is  the  combined  utility  function,  u.  is  the  l  n  constituent 

-L  4.  i_ 

utility  function,  I<M  is  a  scaling  constant  for  the  i  n  utility  function, 
and  K  is  the  scaling  constant  for  the  combined  utility  function.  Speci¬ 
fically,  the  utility  functions  for  attribute  X^  and  respectively  are 

1  +  k^u1  =  ( 1  +  k i k i au i a x  1  a ^ '  * 1  +  k1k1bulb*xlb^  ^  1  +  k1k1cu1c^x1c' )  (2' 

and 


k^u^  =  (1 +  k3k3au3a(x3a) H 1  + k-,k-,wu 


3  3b  3b  3b 


5 ;  ' 1  +  k3k3cu3c  vX3c ' 


;  1 


(3/ 


where  u^  is  the  lower  level  attribute  utility  function,  u  .  is  the 
higher  level  utility  function,  and  the  k’s  are  scaling  constants.  The 
aggregate  utility  function  for  each  group  is 


1  +  Klh  =  ( 1  +  KK^u^ )  i  1  +  ( 1  +  KK3U3 ) ;  1  +  KK^u^  .1  iA, 

where  Ik  is  the  combined  utility  function  for  each  group,  i=1,2,3,  and 
the  K’s  are  scaling  constants.  The  multiplicative  form  adds  complexity 
of  analysis  compared  to  the  additive  form,  but  also  supplies  the  re¬ 
quired  non-compensatory  inter-attribute  relations  necessary  in  this  prob¬ 
lem  (Appendix  A). 

The  utility  independence  condition  (which  was  verified  for  all 
attributes)  allows  the  assessment  of  eight  single  dimension  utility 
functions.  The  utility  function  for  each  attribute  was  needed  to  in¬ 
corporate  the  DM’s  and  advisor's  preferences  and  attitude  toward  risk. 
Because  of  the  many  gerents  at  various  levels  in  HEARD ,  a  refinement 
form  of  social  choice  function  was  used  tc  bring  the  individual  utili¬ 
ties  of  the  DMs  and  advisors  together.  Using  a  modified  form  of  the 
multiple  independent  entity /MCDM  process  of  Banker  and  Gupta  ; 1 973 )  in¬ 
tended  for  decentralized  DMs,  the  utility  functions  were  extracted  for 
each  attribute  from  the  lower  level  advisors  and  DMs  in  each  group 
(G-1,  G-2,  and  G— 3 ) .  These  utility  functions  were  then  presented  to 
intermediate  and  eventually  high  level  DMs  in  each  group  for  refinement. 
These  refined  utility  functions  were  then  shown  to  each  level  of  DM 
until  concensus  vas  reached  on  the  final  form  for  each  group  (C— ",  G-2, 
and  G— 3) .  This  way  of  incorporating  the  group  utility  into  a  single 
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function  seemed  to  work  well  in  this  application  because  it  followed  the 
basic  bureaucratic  "chain  of  command"  hierarchial  decision  making  pro¬ 
cess  of  the  government  (lower  level  advisors  counsel  higher  le,fel  DMs 
and  higher  level  DMs  feedback  policy  which  focuses  this  advice  thereby 
causing  rapid  convergence  to  a  single  social  choice  function  or  opinion; 
The  refined  group  utility  functions  (utilizing  the  data  from  the  refine¬ 
ment  interviews  was  curve  fit  using  the  regression  analysis  subroutines 
NLK0OD;  Meeter,  et  al.,  1977;  and  computer  programs  like  MAUACOK , 
Schlaifer,  197b  for  the  individual  attributes  are  listed  in  Table  5.  An 
example  of  the  group  utility  curves  for  attribute  (number  of  threats 
degraded]  is  shown  in  Figure  14.  The  majority  of  the  utility  curves 
exhibit  a  preference  structure  which  is  risk  averse  as  illustrated 
Figure  14.  The  risk  averse  tendencies  by  the  DMs  and  advisors  were  ex¬ 
pected  in  a  project  which  involves  government  officials  (Levy  ,  1974,. 

Since  concensus  established  the  multiplicative  form  of  combined 
multiattribute  utility  function,  the  task  of  evaluating  the  scaling  con¬ 
stants  for  this  form  were  approached  next.  Using  suggested  assessment 
techniques  (Keeney  and  Raiffa,  1976)  with  the  interviewees,  the  group 
utility  functions  (Table  S)  and  the  attribute  ranges  (Table  4),  the 
scaling  constants  were  evaluated  for  each  group  and  the  results  are 
shown  in  Table  9  for  the  multiplicative  utility  functions.  As  one  ex¬ 
amines  Table  9,  each  group's  relative  strengths  of  the  preferences  for 
the  attributes  become  evident.  For  instance,  the  values  of  the  combined 
utility  function  scaling  coefficients  show  that  Group  2  prefers  a  high 
level  policy  satisfaction  (K^)  and  low  cost  (K^)  over  performance  (K. 
and  (K^)  while  Group  3  values  aerodynamic  ( )  and  electronic  warfare 
performance  (K^)  over  political  (K^)  and  financial  ( -  considerations. 

When  the  sum  of  the  constituent  utility  function  coefficients  is 
not  equal  to  1.0,  then  a  dependency  among  attributes,  which  is  signified 
by  the  multiplicative  form,  is  verified.  When  the  sum  of  the  ccnstituer. 
function  scaling  constants  is  greater  than  one,  the  combined  utility 
constants  (K,  k^  or  k,)  is  between  minus  one  and  zero  (at  minus  one,  all 
constituent  scaling  constants  must  be  equal  to  one).  This  condition 
signifies  a  case  where  a  group's  strengths  of  the  preferences  for 
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Table  9.  Utility  Functions  For  The  Stakeholders 


Aggregated  Utility  Functions 


l+KUi  =  (1+KK1u1)(1+KK2u0)(1+KK3u3)(1+KK4u4) 

where  U^  =  combined  group  utility  function,  i  =  1,2,3 


u.  =  higher  level  attribute  constituent  utility  function 
J  i  =  i t .A 


J  j  = 

L,2,3,4 

Scaling 

Coefficients 

Group  1 

Group  2 

Group  3 

K 

-0.76 

-0.97 

-0.98 

K1 

0.51 

0.30 

0.69 

k2 

0.33 

0.75 

0.46 

0.49 

0.32 

0.92 

4 

0.21 

0.80 

0.45 

Attribute  Utility  Functions 


1+klul  “  (1+klklaula(xla^(1+klklbulb(xlb))(1+klklculc(xlc:>) 
u2  =  u2(x2) 

1+k3u3  =  ^  1+k3lc3au3a^x3a)  H  l+^3k3-Du3b(x3b) )  ( l+k3k3c(x3c) ) 


where  u^  =  lower  level  attribute  utility  function; 
m  =  1,3  n  =  a,b,c 


Scaling 

Coefficients 

Group  1 

Group  2 

Group  3 

kl 

-0.60 

-0.29 

0.14 

0.48 

0.40 

0.38 

kl? 

0.59 

0.37 

0.26 

klc 

0.24 

0.35 

0.31 

k3 

-0.40 

5.04 

-0.97 

k3a 

x3b 

0.51 

0.12 

0.42 

0.29 

0.2  5 

0.48 

k, 

3c 

0.38 

0.13 

0.95 

attributes  are  medium  to  high  ie.g.  =  -.97  for  group  3).  When  the 
sum  of  the  constituent  scaling  constants  is  less  than  one,  then  the  com¬ 
bined  utility  constant  is  greater  than  zero.  This  condition  signifies 
a  case  where  a  group  exhibits  medium  to  weak  preferences  for  the  attri¬ 
butes  of  interest.  As  the  magnitude  of  a  combined  utility  constant  in¬ 
creases,  the  preferences  tend  to  weaken  in  strength  (eq.  k^  =  5.04  for 
group  2 ) . 

Each  group's  (G-1,  G-2,  G-3)  utility  for  the  set  of  alternatives 
described  in  Table  5  and  Table  6  were  calculated  using  the  multiplicative 
form  and  scaling  constants  listed  in  Table  9  •  The  constituent  utili¬ 
ties  for  the  expected  values  of  the  candidate  systems  for  all  three 
groups  are  listed  in  Table  10.  The  combined  group  felicity  for  each 
alternative  EW  retrofit  system  in  the  reduced  !JDSS  (expected  version, 
improved  version,  and  degraded  version)  is  shown  in  Table  11a.  The 
ranking  of  alternatives  step  was  next  accomplished  by  maximizing  the 
expected  individual  group  utilities  according  to  Figure  11.  The  re¬ 
sulting  group  utilities  for  each  alternative  were  generated  by  averaging 
out  the  single  stage  MADA  formulation  of  Figure  11  for  each  alternative 
using  the  equation 

E(u(z,a. ! )  =  [  p,(a. )u  (z.  .(a. ))  (5; 

*  j  J  +■  J-J  X 

where  p4(a. )  is  the  probability  of  outcome  z.  and  ulz.  .(a.)/  is  the 
multiattribute  utility  of  outcome  z.  .,  and  E(u(z,a.))  represents  the 

-*•  J  i 

expected  utility  or  score  for  alternative  The  utility  data  of  Table 
1  la  and  the  probability  data  discussed  earlier  and  illustrated  ir. 

Figure  12  were  substituted  into  this  expected  utility  formulation. 

Table  lib  shows  the  output  of  these  calculations  and  the  resulting 
preference  rankings  for  the  individual  groups  with  respect  to  the  alterna¬ 
tives.  The  closeness  of  the  utility  scores  for  each  group  is  explained 
by  the  fact  that  even  though  utilities  were  elicited  for  the  full  range 
of  each  attribute,  the  alternatives  in  the  UDSS  had  attribute  values 
that  were  in  a  much  narrower  range. 

The  rankings  of  Figure  15,  show  that  the  G-1  operations ,  intelli¬ 
gence)  prefer  the  alternatives  which  aid  aircraft  performance  and  are 
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combined  utility  of  attribute  X  (m  =  A,C,A  for  X-,  and  C  for  XOfor 
Group  n(n=  1,2,3) 
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average  or  compromise  systems.  This  was  expected  since  many  of  the  par¬ 
ticipants  in  G-1  have  air  crew  experience  'pilots,  navigators,  weapons 
operators ,  etc . ) .  G-2  preferred  the  compromise  and  low  cost  alterna¬ 

tives.  This  also  was  expected  since  budgetary  constraints  and  political 
agreements  are  driving  forces  for  the  government  policy  makers.  It  is 
noted  that  there  is  a  correlation  in  the  upper  levels  of  alternative 
choices  of  G-1  and  G-2  which  is  possibly  precipitated  by  the  close  inter¬ 
action  between  the  DMs  and  advisors  in  G-1  and  G-2  discussed  in  Section  2. 
G-3  \ program  managers ,  contractors,  analysts,  etc.)  preferred  the  high 
EV.’  and  aircraft  performance,  high  cost,  and  compromise  alternatives. 

These  choices  were  anticipated  since  engineers,  contractors,  and  analysts 
in  G-3  are  basically  performance  oriented  and  consider  cost  secondarily. 
Alternatives  A  (high  aircraft  performance)  and  S  (best  compromise)  were 
highly  preferred  by  all  groups.  Because  no  alternative  was  ranked  as 
most  preferred  groups,  and  to  continue  with  the  theme  of  a  general  appli¬ 
cation,  the  final  modelling  step  was  the  combination  of  the  three 
separate  group  (G-1,  G-2,  and  G-3)  multiattribute  utility  functions  into 
a  single  social  choice  function  so  that  final  ranking  can  be  performed 
for  the  EWARD  presented.  Because  it  can  be  seen  from  Table  11b,  and 
Figure  15  that  there  are  conflicting  ranking  for  alternatives,  a  means 
was  required  to  obtain  combined  group  concensus.  Because  there  are  three 
groups  and  more  than  three  alternatives,  there  was  no  way  of  obtaining 
concensus  (through  popular  techniques  like  simple  majority  rule,  simple 
additive  weighting,  etc.)  without  violating  Arrow’s  axioms  in  the  im¬ 
possibility  theorem  (Arrow,  1963).  This  is  because  interpersonal  com¬ 
parison  of  utilities  is  required.  Nevertheless,  concensus  is  required, 
and  two  techniques  which  can  aggregate  the  group  utilities  are  the 
cardinal  social  welfare  function  discussed  by  Keeney  and  Kirkwood  (1975' 
and  the  Extended  Cor.tr ibutive  Rule  method  (ECR)  discussed  by  Nakayama, 
et  al., (1979). 

The  Extended  Cor.tributive  Rule  method  (ECR)  was  used  to  aggregate 
individual  groups'  preferences  into  a  single  choice  function  ( Nakayama , 
et  al.,  1979).  ECR  amalgamates  the  preferences  of  the  DMs  in  a  way  that 
incorporates  directly  the  degree  of  confidence  of  all  the  individual 
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groups  in  their  own  preferences  and  in  other  groups'  preferences,  and 
the  intensity  of  each  preference.  ECR  was  particularly  applicable  to 
EWARD  since  it  considers  preferences  between  two  alternatives  at  a  time 
and  therefore  gives  an  output  which  is  readily  transformed  into  an  ISX 
digraph  (Warfield,  1976)  for  display  purposes.  The  ECR  method  of  com¬ 
bining  group  preferences  was  chosen  over  the  simple  linear  additive  and 
multiplicative  forms  cf  combining  group  utility  in  this  application  be¬ 
cause  of  two  reasons: 

1 .  ECR  specifies  a  way  of  making  interpersonal  comparison  cf 
utility  (each  group  ranks  the  importance  of  the  opinion  cf  all  groups  so 
that  weights  can  be  established  for  each  group's  utility).  This  concept 
of  intergroup  weighing  makes  intuitive  sense  in  a  governmental  setting 
where  the  various  groups  realize  their  relative  position  with  respect 

to  the  political  structure  which  must  eventually  authorize  funding  for 
the  EWARD  production. 

2.  ECR  method  allows  a  preference  threshold  to  be  incorporated 
into  the  ranking  of  alternatives  step.  This  thresholding  feature  af¬ 
fords  the  DK  the  opportunity  to  not  only  establish  specific  preference 
relations  between  alternatives,  but  also  reveal  the  strengths  of  these 
preference  relations.  These  pairwise  preference  relations  can  then  be 
easily  displayed  on  a  digraph. 

The  ECR  algorithm  is  now  described.  For  a  set  of  alternatives 
A  =  (A.j ,,,,,,  ,A  ) ,  and  group  utility  functions  u^  =  iu. ,  u^,  u~)T  let 
w  be  the  weight  which  group  y  imposes  on  the  utility  of  group  z. 

That  is,  w  represents  group  y's  perception  of  the  fraction  of 
the  whole  opinion  that  group  z  influences.  We  define  the  quantity 


3  i  3  i 

X  =  I  w.  •  Au,.  +  »(  I  w.  •  Kir. ( C ,  au  )  -  e] 

i=1  1  irl  X 

3  i 

where  w.  =  (  J  w  •  )/3,a  >  0,6  >  0,  and  ao  ...  =  u.  (A.)  -  u.  ,A.y 
1  y=l  y  •>  -  J  1  K 


For  two  alternatives  A.,  A ^  c  A;  A.  is  preferred  tc  A^  ,Ai  A^),  at 
an  opinion  level  a  if  and  only  if  X  >  C.  All  possible  combinations  cf 
alternatives  taken  two  at  a  time  are  categorized  with  respect  to  a 
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preference  existing  or  not  (binary  relation).  The  parameter  a  indicates 
the  weighing  which  is  given  to  opposite  preference  opinions.  It  is  a  way 
of  requiring  a  level  of  coincidence  tall  or  a  majority  of  opinions  agree 
in  order  to  establish  a  preference  relationship;  of  individual  group 
opinions  (i.e.,  if  a  =  0,  no  consideration  for  opposite  opinions  is 
given  (no  agreement  of  opinion  is  required)  and  the  ECR  takes  the  form 
of  a  linear  additive  SWF;  if  a  is  large,  then  complete  unanimity  of 
opinion  is  required  to  establish  preference  relations  as  an  opposing 
preference  is  heavily  weighed).  The  parameter  6  is  used  to  indicate  the 
intensity  (strong,  weak,  etc.)  of  the  preference  relations.  This 
parameter  allows  the  DM  to  differentiate  the  strong  from  the  weak  prefer¬ 
ence  relations.  It  is  in  effect  a  threshold  which  can  be  set  to  allow 
only  preference  relations  above  this  value  to  be  recognized.  The  para¬ 
meters  a  and  8  are  initially  set  at  large  values  and  the  pairwise  pref¬ 
erence  relations  are  determined.  These  preference  relations  are  trans¬ 
formed  to  a  digraph  as  in  an  ISM  process.  If  the  digraph  arrangement  of 
alternatives  does  not  have  vertical  structure,  then  the  threshold  s  is 
decreased  in  small  increments  (which  has  the  effect  of  establishing  the 
weaker  pairwise  preference  relations  which  before  were  cancelled  due  to 
the  large  threshold)  until  a  vertical  digraph  is  established  or  6  =  2. 

If  6  =  0  and  a  vertical  digraph  is  still  not  evident,  then  the  coinci¬ 
dence  of  opinion  parameter,  a  ,  is  decreased  and  the  algorithm  repeated 
until  a  vertical  or  near  vertical  digraph  results.  The  ECR  method  was 
also  deemed  applicable  to  EWARD  because  of  the  previous  discussion  of 
situations  where  occasionally  certain  DMs  decide  to  not  take  part,  or  to 
delay  taking  part  in  the  decision  process.  Through  the  multiple 
independent  entity /MCDM  refinement  technique  (Banker  and  Gupta,  1975) 
this  procrastinating  DM's  preference  can  be  bypassed  by  his  or  her 
specific  group  preferences,  aid  surrogately  included  through  the  weights 

w,  .  Also  adjustments  made  in  w. ,  and  a  could  be  used  to  motivate  the 
yz  i 

DM  into  taking  a  prompt  active  role. 

The  weights  shown  in  Table  12  were  elicited  from  each  group  to 
establish  the  intergroup  comparison  cf  utilities.  This  ECR  algorithm  was 
programmed  on  the  digital  computer  for  efficiency  because  cf  all  the 
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required  alternative  comparisons.  Information  from  Tables  11b,  and  12 
were  used  along  with  various  values  of  a  and  6  to  establish  the  prefer¬ 
ences  shown  on  Table  13  with  resulting  digraphs  on  Figure  16. 

Results 

A  digital  computer  coding  of  the  ECR  method  gave  a  binary  prefer¬ 
ence  output  for  each  pairwise  set  of  alternatives  which  was  converted 
through  an  ISM  format  (Table  13)  to  the  digraphs  of  Figure  16.  For  the 
various  values  of  a  and  e,  Figure  16  shows  that  there  are  three  alter¬ 
natives  which  rank  consistently  higher  than  the  other  alternatives. 

These  alternatives  ' 1 ,  4 ,  and  6 )  exhibit  medium  or  compromise  values  of 
attributes  of  cost  and  EW  performance  along  with  high  aircraft  perform¬ 
ance.  For  a  (the  parameter  which  weighs  opposite  preference  opinions 
heavily)  in  the  range  of  0  <  a  <  .095  and  6  =  0  (with  a  =  0,  the  ECR 
social  choice  function  assumes  the  form  of  a  linear  additive  SVJF) 
alternative  6  dominates  (Figure  16a).  As  a  is  increased  to  larger 
values,  the  alternatives  aligned  themselves  in  two  groups  of  a  preferred 
set  !1,  4,  and  3)  and  a  dominated  set  (7)  as  illustrated  in  Figure  16b 
and  16c.  As  a  threshold  value  was  brought  in  ie  increases  from  C),  the 
ranking  of  Figure  16a  started  to  decompose  until  the  strengths  of  all 
preference  relations  are  overcome  and  complete  unaniminity  would  be  re¬ 
quired  to  establish  a  preference  relation  (Figure  lod).  Khen  these  re¬ 
sults  were  presented  to  the  advisors  and  DMs  in  all  groups,  there  was 
concensus  that  alternative  S  was  the  most  desirable  and  its  specifica¬ 
tions  would  be  used  as  the  standard  in  the  RFP. 


Sensitivity  Analysis 

A  sensitivity  analysis  was  conducted  to  examine  the  robustness  of 
the  final  ranking  of  alternative  systems,  and  to  point  out  critical 
areas  in  this  approach  to  EWARD. 

As  a  check  of  the  Dll’s  consistency  in  the  MOOT/MA’JT  process,  the 
utility  based  ranking  of  alternatives  was  made  just  prior  to  aggregating 
the  group  utilities  into  a  joint  SCF.  The  group  utility  was  calculated 
for  all  alternatives  not  in  the  NDSS.  The  combined  group  utility  for 
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Figure  16.  Social  Choice  Ranking  Of 
Alternatives  Using  ECR 
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these  alternatives  were  calculated  and  compared  to  those  in  the  iiDSS. 

The  resulting  rankings  showed  that  alternatives  2,  3,  5  and  6  are  in¬ 
deed  dominated  in  all  groups.  This  indicates  that  the  DHs  were  consis¬ 
tent  in  the  value  scoring  of  alternatives,  elimination  by  aspects,  and 
utility  elicitation  tasks. 

The  significance  of  the  accuracy  of  the  input  data  on  the  ranking 
of  the  alternatives  was  tested  by  varying  the  supplied  values  of  Table 
5.  Varying  the  values  of  all  the  attributes  by  five  percent  for  each 
alternative  first  in  a  beneficial  and  then  detrimental  direction  (which 
had  the  same  effect  as  varying  the  distributions  over  the  attribute  val¬ 
ues)  did  not  affect  the  groups’  preference  ordering  of  the  top  three 
alternatives.  Varying  all  attribute  levels  by  five  percent  in  a  bene¬ 
ficial  direction  for  the  second  best  alternative,  caused  this  alterna¬ 
tive  (#4)  to  become  optimal.  Changing  the  life  cycle  cost  attribute  by 
six  percent  caused  a  decision  switch  from  alternative  5  to  alternative 
4.  These  facts  should  alert  the  analyst  to  the  realization  that  while 
alternative  system  parameter  accuracy  is  important,  there  may  be  margi¬ 
nal  returns  to  committing  excessive  resources  to  insure  that  the  data  is 
extremely  accurate.  This  is  particularly  significant  when  considering 
that  the  data  for  the  policy  satisfaction  attribute  was  obtained  primari¬ 
ly  through  subjective  estimates  from  the  DMs  and  their  advisors. 

Tne  sensitivity  of  the  preferred  solution  to  the  individual  group 
utility  functions  was  next  examined.  The  individual  utility  functions 
for  the  attributes,  and  the  individual  group  utility  functions  for  each 
group  were  varied  by  several  percent  up  to  five  percent.  The  results 
showed  that  variations  up  to  five  percent  for  the  constants  in  the  indi¬ 
vidual  attribute  utility  functions  did  not  cause  a  change  in  the  rankings 
of  the  alternative  systems  in  the  NDSS.  Conversely,  changes  in  the 
scaling  constants  in  the  amalgamated  utility  functions  for  the  individual 
groups  of  only  three  percent  caused  variation  in  the  ranking  order  of  the 
top  three  alternatives  for  all  groups.  These  results  suggest  that  the 
analyst  needs  to  devote  adequate  efforts  to  ensure  accuracy  in  scaling 
constants  for  the  combined  utility  functions.  This  was  an  indication  of 
the  need  for  importance  of  careful  amalgamation  of  utilities  in  each 
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group  through  the  use  of  a  technique  like  the  multiple  independent 
entities  algorithm  (Banker  and  Gupta,  197S). 

A  check  on  the  effects  of  the  variation  of  the  individual  group’s 
stated  minimum  acceptable  attainment  level  was  accomplished  next  since 
these  attainment  levels  were  the  basis  for  an  elimination  by  aspect  ex¬ 
ercise.  It  is  noted  that  because  all  attainment  levels  of  each  individ¬ 
ual  group  had  to  be  justified  to  the  other  groups,  only  reasonable  and 
fairly  conservative  attainment  levels  were  supplied  by  the  groups. 

While  variation  by  twenty  percent  in  several  attainment  levels  (policy 
satisfaction,  threats  degraded,  etc.)  caused  variation  in  the  membership 
of  alternatives  in  the  NDSS,  these  affected  alternatives  (5  and  7-  were 
marginal  and  not  prominently  ranked  in  the  final  analysis. 

Lastly,  the  robustness  of  the  selection  of  the  optimum  alternative 
system  was  examined  with  respect  to  the  weighing  of  each  other's  opinion 
by  the  individual  groups.  In  the  ECR  group  utility  aggregation  algor¬ 
ithm,  the  intergroup  opinion  weights  were  varied  up  to  ten  percent  with 
only  minor  variation  in  the  final  alternative  rankings  (alternative  sys¬ 
tem  A  and  alternative  system  1  changed  places  in  the  rankings ) .  Alter¬ 
native  8  was  still  the  optimum  choice  even  with  the  aforementioned  var¬ 
iation  in  the  intergroup  comparison  of  utilities. 

Validation  of  the  Decision  Procedure 

The  DMs  and  advisors  who  took  part  in  this  exercise  expressed  sat¬ 
isfaction  in  the  MOOT /MAUI  approach  to  EWARD .  Therefore,  this  technique 
was  used  in  a  validation  exercise  to  see  how  it  would  have  done  on  ar. 
actual  system  which  is  operational  now.  The  data  from  a  recent  Elv 
retrofit  system  was  processed  in  a  pre-analysis  phase  (Section  3;  to  fit 
the  modelling  approach  of  the  combined  MOOT/!'  1AUT  method  presented  in 
this  chapter.  Four  alternative  systems  were  reduced  in  the  three 
groups  (G-'i,  G-2,  G— 3 )  to  a  set  of  non-dominated  alternatives 
from  which  the  groups  selected  a  "best"  alternative.  The  alter¬ 
native  which  was  selected  was  a  modification  of  the  system  which  was 
actually  retrofit  on  the  aircraft. 


All  groups  agreed  that  the 
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system  selected  by  the  MOOT/F.AUT  approach  was  superior,  and  was  selected 
in  a  more  efficient  manner  compared  to  the  system  'which  was  eventually 
retrofit.  The  DMs  expressed  their  opinions  for  the  discrepancy  and 
these  can  be  summed  up  in  two  points: 

1 .  There  was  no  comprehensive  set  of  criteria  ( such  as  on  Table  1 ) 
which  could  be  used  to  judge  system  goodness  early  in  the  acquisition 
life  cycle  in  the  actual  retrofit. 

2 .  There  was  a  lack  of  communication  between  pertinent  stakehol¬ 
ders  in  the  actual  -retrofit  which  was  significantly  ameliorated  by  the 
MOOT/MAUT  technique.  Therefore,  it  is  concluded  that  this  exercise  val¬ 
idates  the  appropriateness  and  efficiency  of  the  use  of  MCDT  [specifi¬ 
cally  the  MOOT/MAUT  approach)  in  the  early  phases  of  the  DOD  Equipment 
Acquisition  Life  Cycle. 

Method  Acceptability 

In  this  effort,  twenty-one  DMs  and  advisors  from  the  various  stake¬ 
holder  groups  (Appendix  C)  took  part.  Interviews  with  these  participants 
consisted  of  fact  finding  and  preference  elicitation  sessions.  The 
average  time  spent  with  each  participant  was  2. A  hours,  and  the  maximum 
time  for  any  individual  was  IS  hours.  The  majority  of  participants 
(nineteen)  expressed  satisfaction  and  acceptance  of  this  approach  tc 
EWARD ,  and  indicated  they  would  be  in  favor  of  using  this  technique  in 
future  efforts.  The  majority  of  participants  gave  the  opinion  that  the 
two  main  benefits  of  this  approach  to  EWARD  are: 

1.  The  final  product  is  an  acceptable,  cost  effective  system. 

2.  There  is  a  definite  savings  in  time  accrued  through  this  ap¬ 
proach  (the  participants  estimated  that  to  one  years  time  (50%)  in  the 
Conceptual  Phase  could  be  saved  utilizing  this  technique)  compared  to  the 
present  design  procedure. 

Implementation 

As  mentioned  in  Section  2  and  3,  the  application  of  the  MOOT/MAUT 
approach  to  EWARD  should  be  in  the  Conceptual  Phase  of  the  Defense 
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Systems  Acquisition  Cycle  before  the  PI-IP  is  prepared.  The  application 
at  this  point  in  the  acquisition  cycle  would  allow  for  a  maximum  of  bene¬ 
fits  (determine  the  system  configuration  and  get  all  pertinent  groups 
communicating)  without  the  need  for  legislation,  or  any  changes  of  the 
current  regulations.  The  current  regulations  do  not  generally  specify 
application  of  particular  techniques,  but  they  allow  for  the  applica¬ 
tion  of  desirable  techniques.  The  analysts  required  could  be  drawn  from 
the  staffs  in  all  three  groups  (user  Commands,  Ha.  USAF  and/or  DOD,  and 
Systems/Logistics  Commands),  and  formed  into  a  dedicated  team  for  the 
EWARD  (verses  working  at  the  retrofit  problem  in  fragmented  groups  as 
they  do  currently)  without  the  requirement  for  additional  personnel. 

This  team  would  ideally  be  responsible  to  the  DSARC/SECDEF  to  allow  the 
team  to  operate  with  the  cooperation  of  all  groups  but  immune  from  the 
influence  of  any  one  group. 

5.  Summary 

In  this  effort,  a  decision  situation  involving  Electronic  Warfare 
Aircraft  Retrofit  Design  (EWARD)  was  modelled  and  resolved  using  the 
combined  MOOT/MAUT  approach.  The  chapter  began  by  an  overview  of  the 
DOD  Equipment  Acquisition  Cycle  as  set  down  in  various  regulations  and 
directives.  Esoteric  considerations  in  the  electronic  warfare  community 
were  described  because  of  difficulties  they  cause  in  the  acquisition 
procedure.  The  primary  stakeholder  groups  were  identified  along  with 
their  interaction  in  the  equipment  retrofit  situation.  The  decision 
makine  procedure  was  applied  to  the  Conceptual  Phase  of  the  DOD  Equip¬ 
ment  Acquisition  Cycle  where  it  was  intended  to  produce  two  results: 

1.  A  salient  set  of  design  criteria  'candidate  system  descript¬ 
ors)  which  can  be  used  in  judging  the  goodness  of  a  proposed  EW  alter¬ 
native  design  in  the  early  phases  of  the  EW  equipment  acquisition. 

2.  A  decision  making  procedure  for  candidate  system  selection  as 
a  basis  for  system  selection  and  the  RFP. 

The  EWARD  situation  was  modelled  around  attributes  adequate  for 
judging  the  EW  retrofit  system  arid  a  set  of  realistically  based  alter¬ 
natives  for  a  retrofit  design.  These  alternatives  were  supplied  with 
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attribute  levels  and  the  associated  risk  for  realization  of  the  alter¬ 
natives.  Using  the  MCDT  approach,  the  combined  M0OT/HAUT  process  was 
used  to  solve  the  EKARD  situation.  A  pre-analysis  phase  was  ^.sed  to  struc¬ 
ture  the  decision  situation.  The  optimization  step  consisted  of  a 
multi-dimensional  elimination  by  stochastic  dominance  exercise  since  the 
impacts  of  implementing  the  various  alternative  systems  are  provided  by 
the  competing  contractors.  The  resulting  NDSS  was  further  reduced  in 
the  number  of  alternative  systems  when  the  individual  groups  supplied 
minimum  acceptable  attainment  figures  for  the  attributes  as  a r.  input  tc 
an  elimination  by  aspects  exercise.  The  MAUT  technique  of  multiattri¬ 
bute  decision  analysis  was  used  to  model  and  rank  the  alternatives  in  the 
NDSS  by  developing  a  cardinal  utility  SCF  for  each  group.  These  group 
utility  functions  were  amalgamated  into  an  ultimate  SCF  which  produced  a 
final  ranking  of  the  NDSS  and  identification  of  alternative  £  (Table  5) 
as  the  optimum  system  configuration.  Group  concensus  corroborated  this 
alternative  selection.  A  certain  amount  of  iteration  was  required  in 
all  steps  of  the  MOOT/MAUT  process  in  order  to  converge  tc  an  acceptable 
policy  choice. 

A  subsequent  sensitivity  analysis  of  the  final  ranking  of  the  alter¬ 
natives  (with  alternative  3  as  the  identified  optimal  configuration; 
produced  the  following  observations:  the  DMs  were  consistent  with  resp¬ 
ect  to  value  scoring  and  utility  function  scoring  of  the  attribute  as  a 
basis  for  forming  the  NDSS  and  then  ranking  the  resulting  alternatives: 
the  final  ranking  of  alternatives  was  somewhat  sensitive  to  the  accuracy 
of  the  alternatives  systems  impact  data,  and  the  stated  minimum  accepta¬ 
ble  attainment  levels  of  the  individual  groups;  the  final  ranking  was 
very  sensitive  to  the  accuracy  of  the  constants  in  the  individual  group 
aggregated  utility  functions.  A  validation  exercise  was  then  carried 
out  using  data  from  a  recent  EW  retrofit  system.  The  MOOT/MAUT  approach 
described  earlier  was  used  in  the  pre-analysis,  modelling  and  identifies- 
tion  of  the  optimum  system  configuration.  The  groups  selected  a  system 
by  concensus  which  all  DMs  and  advisors  stated  was  the  superior  system 
(the  system  was  a  modification  of  the  actual  system  now  in  the  aircraft; 
of  the  alternatives  available. 
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We  have  illustrated  a  need  for  and  the  use  of  a  MCDT  approach  in  the 
early  phases  of  the  DOD  EK  equipment  acquisition  effort.  The  HOOT/MAUT 
approach  can  efficiently  produce  a  solution  to  the  EWARD  situation  which 
contains  risk/uncertainty  elements.  The  validation  effort  demonstrated 
that  such  an  approach  forces  DMs  and  their  advisors  to  consider  the  sal¬ 
ient  attributes  early  and  to  communicate  {or  at  least  add  opinions  and 
inputs  to  the  situation)  with  other  stakeholder  groups.  The  MOCT/MAUT 
technique  efficiently  defines  the  most  desirable  alternative  available. 
The  MOOT/MAUT  technique  includes  the  DMs  in  many  steps  in  the  technique 
which  should  give  the  DMs  confidence  in  the  results  obtained.  The 
multiplicative  form  of  scoring  function  for  evaluation  of  alternative 
configurations  is  an  appropriate  form  in  EWARD  when  the  relationships  of 
the  attributes  and  the  desire  for  non-compensatory  policies  are  incor¬ 
porated  into  this  decision  situation. 
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CHAPTER  6 


SUMMARY,  CONCLUSIONS ,  AND  RECOMMENDATIONS 


1 .  Summary 

In  this  effort,  comparison  of  two  multiple  criteria  decision  tech¬ 
niques  (MOOT  and  MAUT)  motivated  the  generation  of  a  more  efficient 
decision  support  methodology.  This  combined  MOOT /MAUT  method  aggregates 
the  complementary  aspects  of  both  approaches.  A  simple  example  of  the 
approach  was  followed  by  a  detailed  application  to  a  Department  of 
Defense  equipment  acquisition  situation  involving  the  retrofitting  of  a 
special  purpose  aircraft.  Decision  makers  and  advisors  from  identified 
primary  stakeholder  groups  took  part  in  the  EWARD  application  and  sub¬ 
sequent  validation  exercise.  A  framework  for  electronic  warfa re  air¬ 
craft  retrofit  was  developed  using  the  combined  multi-criteria  M00T/MAU7 
process.  A  set  of  criteria  or  attributes  was  developed  in  the  EWARD 
application  which  can  be  used  to  evaluate  alternative  system  configura¬ 
tions  in  a  comprehensive  manner  throughout  the  equipment  acquisition 
cycle. 

The  major  contributions  of  this  effort  are  the  delineation  of  the 
systems  engineering  process  algorithms  for  MOOT  and  MAUT( pp23-32, 49-56 ) , 
the  development  of  a  combination  MOOT /MAUI  methodology  based  on  the  com¬ 
plementary  characteristics  of  both  approaches  (pp  69  -  77),  the  develop¬ 
ment  of  an  efficient  framework  for  EWARD  through  the  extension  of  a  MODI 
to  that  application  (pp  98  -  143),  and  the  generation  of  a  set  of  cri¬ 
teria  for  evaluation  of  alternative  retrofit  EW  systems  in  the  Defense 
Systems  Acquisition  Cycle  (pp  98-143). 

2.  Conclusions 

Based  on  this  research,  the  following  conclusions  can  be  drawn: 

-  While  there  are  operational  and  philosophical  differences  between 
MOOT  and  MAUT,  both  processes  are  mental  constructs  to  approaching 
decision  situations,  and  when  they  are  compared  at  the  same  level, 
there  should  be  no  essential  differences  in  structure  between  them. 

At  che  application  level,  both  MOOT  and  MAUT  approaches  seek 


identification  of  a  strategically  equivalent  optimal  policy,  assuming 
the  DM  is  consistent  and  the  NDSS  is  complete. 

-  The  complementary  phases  of  MOOT  and  MAUT  are  compatible  for  combina¬ 
tion  into  a  single  methodology. 

Specific  conclusions  which  can  be  drawn  from  the  EWARD  application 

are  as  follows: 

-  A  MCDM  approach  has  merit  in  an  EWARD  application,  particularly  in 
the  early  stages  of  this  application.  The  combined  comprehensive 
resource  MOOT /MAUT  approach  will  increase  the  efficiency  of  EWARD  in 
an  overall  time  and  resource  savings. 

-  The  multiplicative  form  of  scoring  function  for  evaluation  of  alterna 
tive  configurations  is  an  appropriate  form  in  EWARD  to  insure  sensi¬ 
tivity  of  the  scoring  form  to  small  differences  ir.  the  alternatives 
(pp  121  to  129,  A-9  to  A-12) . 

-  The  EWARD  framework  presented  is  an  acceptable  arid  desirable  approach 
to  this  specific  defense  systems  equipment  acquisition  situation 
according  to  the  decision  makers  in  the  identified  primary  stake¬ 
holder  groups. 

-  Careful  assessment  of  preferences, and  corroboration  of  the  scaling 
constants  in  the  aggregated  utility  functions  of  DMs  and  advisors  is 
critical  to  identify  the  optimal  system  configuration  correctly. 

3.  Recommendations 

From  the  research  and  application  efforts,  the  following  recommend 

ations  can  be  offered: 

-  The  combined  MOOT/MAUT  methodology  is  feasible  for  implementation  in 
EWARD  in  the  Conceptual  Phase  of  the  Defense  Systems  Equipment 
Acquisition  Cycle.  This  process  should  be  implemented  utilizing  the 
available  analytic  and  technical  staffs  of  the  identified  stake¬ 
holder  groups.  For  convenience,  it  is  suggested  that  these  staffs 
should  be  organized  in  a  single  team  mode  under  the  direction  cf 
SECDEF /DSARC . 

-  The  set  of  developed  technical  criteria  should  be  utilized  in  EWARD 
as  a  comprehensive  means  to  evaluate  retrofit  system  configurations. 
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As  a  result  of  our  efforts,  we  can  identify  the  following  areas  o 
further  research.  There  is  a  need  to  further  develop  techniques  for 
selection  of  the  optimal  policy  from  a  non-dominated  solution  set  in 
ways  that  facilitate  decision  maker-analyst  interaction.  On  the  v/nole 
this  important  area  has  received  little  effort  from  the  MOOT  advocates 
Another  area  for  further  investigation  concerns  the  need  for  more  ade¬ 
quate  modelling  of  the  behavioral  aspects  of  decision  situations  so 
that  by  incorporating  a  DM’s  cognitive  style,  there  would  result  in¬ 
creased  DM  acceptability  of  the  analytic  approach  and  the  results. 
Additionally,  research  aimed  at  examining  mathematically,  the  prefer¬ 
ence  space  at  pre-optimization  (for  MAUT)  and  post-optimization  ifcr 
MOOT)  is  a  direction  for  further  efforts  which  would  aid  in  the  steps 
of  modelling, ranking  alternatives,  and  decision  making  for  multiple 
criteria  decision  situations.  Efforts  are  also  needed  to  further  cnar 
acterize  the  stated  objective  of  national  policy  satisfaction  as  it 
relates  to  EWARD. 
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APPENDIX  A 


ON  WEAKENED  SUFFICIENCY  REQUIREMENTS 
FOR  THE  MLETIPLICATIVE  FORM  OF  VALUE  FUNCTION 

1.  Introduction 

Mutual  preferential  independence  of  attributes  is  generally  used  as 
a  sufficiency  condition  for  the  multiplicative  form  of  value  function. 
Often  the  effort  to  verify  existence  of  this  condition  is  considerable. 

In  this  appendix,  new  and  weakened  sufficiency  conditions  are  given  for 
the  multiplicative  form  of  value  function.  Use  of  these  new  conditions 
will  generally  require  much  less  effort  than  use  of  the  mutual  prefer¬ 
ential  independence  conditions.  Also  the  new  sufficiency  conditions  will 
often  present  very  desirable  measurement  sensitivity  conditions. 

Section  2  discusses  the  motivation  for  use  of  multiplicative  form  of 
value  f 'unction.  Section  3  presents  and  proves  the  existence  of  weaker 
conditions  which  allow  use  of  the  multiplicative  function  while  allevi¬ 
ating  much  of  the  verification  process.  Finally,  section  4  presents  a 
numerical  application  which  concerns  aircraft  retrofit  requirements. 

2.  The  Additive  Value  Function 

The  popularity  of  the  additive  form  of  measureable  value  functions  is 
warranted  because  of  the  facility  of  assessment  of  the  constituent  value 
functions  and  ease  of  evaluation  of  the  scaling  constants  (Keeney  and 
Paiffa,  1976;  Dyer  and  Sarin,  1979) .  Unfortunately,  two  drawbacks 
should,  in  practice,  often  discourage  the  widescale  use  of  the  additive 
form  of  value  function.  The  additive  form  of  value  function  is 

n 

v(x)  =  ^  ki*vi(xi)  (A-1) 

where  v(x)  is  a  scalar  signifying  the  score  for  a  specific  action  with 
attribute  levels  x^,v^(xj  is  a  component  value  statement  for  attribute 
level  x^,x  is  an  n  vector  of  attribute  levels,  and  k ^  is  a  scaling 
constant.  It  is  proper  to  use  this  additive  form  only  when  the 
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attributes,  x^,  are  mutually  preferentially  independent  (MPI)  (Keeney  and 
Raiffa,  1976),  and  this  can  be  difficult  for  the  gerent  to  verify.  It  is 
a  sizable  task  to  show  MPI  of  attributes  where  the  dimension  of  the  value 
attributes,  n,  is  large. 

Another  shortcoming  of  the  additive  form  is  that  it  tends  to  be  insen¬ 
sitive  to  individual  attribute  levels.  Additive  forms  are  compensatory 
in  the  sense  that  an  increase  in  one  attribute  can  canpensate  for  a  decrease 
in  any  other  attribute.  This  means  that  large  increases  or  decreases  in 
any  one  attribute  may  be  offset  by  changes  in  other  attribute  levels  and 
consequently  may  have  little  effect  on  the  scoring  value  of  the  total 
model.  Huber  and  Johnson  (1977)  have  pointed  out  that  this  compensatory 
characteristic  may  be  undesirable  in  many  applications. 

3.  The  Multiplicative  Value  Function 


A  form  of  value  function  which  alleviates  these  difficulties  is  the 
multiplicative  form.  While  the  requirement  for  MPI  of  attributes  is  a 
sufficient  condition  for  a  multiplicative  form  of  value  function,  it  is 
not  a  necessary  condition  as  it  was  for  the  additive  form.  Dyer  and 
Sarin  (1979) ,  building  on  the  work  of  Fishbum  (1976)  and  Keeney  and 
Paiffa  (1976) ,  have  determined  a  sufficient  condition  for  the  multiplica¬ 
tive  form  of  the  general  multilinear  form.  If  attributes  X, ,X_,,,X  are 
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mutually  weak  difference  independent  (MWDI) ,  then  the  form  of  the  value 
function  is: 


n 


+K 


v(x)  =  z  k.v. (x.)  +  K  y  k.k  v. (x.)v  (x.) 
i=l  1  1  1  i=i  1  J  1  1  J  7 

j>i 

ii  i 

l  k.k.k  v.  (x.  5v.  (x.)v.  (x.) - +K11-  .7k.v.(x.) 

i=l  1  J  1  1  J  J  x  x  1 
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or 

1  +  Kv(x)  =  -j  [1+Kk.  v.  (x. )  ] . 

i=l  1  x  x 


(A-3) 
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To  continue  the  development ,  it  is  desirable  to  define  weak  difference 
independence  (WDI) . * 

Definition:  Attribute  X..  is  WDI  of  Xj  if  given  any  a^,  b^ ,  c^, 
die  Xi,  such  that  v(ai,av) -v(bi<a-)>v(ci,ar)-v(di,aT-)  for  sore 
ai  eXi'  ifc  is  r®5uired  that  v(a.jbT)-v(b.jbT)  >  v(c.jbT) -v(d.br) 

for  any  b~e  XT. 

Thus  WDI  means  that  the  ordering  of  preference  differences  depends  only 

on  the  value  differences  associated  with  attribute  X.  and  not  on  the 

1 

fixed  value  of  all  other  attributes  of  Xt.  The  attribute  X.  is  1©!  of 

1  l 

Xr  if  the  value  function  is  of  the  form 

I 

v(Xi,XT)  =  g(Xr)  +  h (Xt)  viX^Xr)  (A-4) 

f 

for  all  X^ ,  Xt,  and  Xt,  '/.here  g  (Xt)  and  h  (X—)  >  0  are  functions  which 
depend  only  on  Xt. 

A  physical  interpretation  of  this  definition  of  WDI  will  now  be 

presented  for  an  equipment  retrofit  design  effort.  It  is  assumed  that 

only  two  attributes  are  important  to  the  problem,  X^  which  represents 

volume  and  X^  =  XJ"  which  represents  cost.  The  object  is  to  minimize  the 

cost  and  the  volume  of  the  retrofit  equipment.  To  check  if  X^  is  WDI  of 

Xp  we  first  choose  levels  of  a^,b^,c^,d^cX^  and  a~  eX~,  so  that  the 

exchange  of  the  combination  of  attributive  levels  (b^^j)  for  the  pair 

(a^,aj)  is  preferred  to  the  exchange  of  pair  (d^,a~)  for  (c^,ap .  if 

this  preference  order  is  preserved  for  other  levels  of  attribute  X^, 

that  is  to  say  if  the  exchange  of  (b-^b^j  for  the  combination  (a^b^j  is 

preferred  to  the  exchange  of  pair  (d^,b~)  for  (c^,bp  for  any  bj-  eXp 

then  X.  is  WDI  of  X~.  In  this  case  let  a.  =  4m^,  b.  =  5m^,  c.  =  2m^, 

I3  1  g  1^  1  1 

d.  =  3m  and  ar  =  $10  ,  and  assume  that  4m~  equipment  volume  fills  the 
1  1  3 

allotted  space  and  that  5m  of  equipment  means  a  cutback  of  a  co- located 
equipment  function.  To  satisfy  the  above  requirement  at  a  single 
attribute  level,  the  decision  maker  (DM)  must  prefer  the  exchange  of  a 
system  with  characteristics  of  (5m\  $10^)  for  a  configuration  (4m^,$10^) 


*The  symbol  Yt  is  used  to  indicate  all  components  of  Y  not  contained 
in  Y  _. .  1 
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over  the  exchange  of  a  configuration  (3m  ,$10  )  for  a  configuration 
3  6 

(2m  ,$10  ).  WDI  requires  that  this  preference  order  for  exchanges  must 
apply  for  other  levels  of  X—  such  as  by  =  $1.5  X  106  in  each  system 
configuration.  Thus  the  DM  must  still  prefer  the  exchange  of  system 
(5m  ,$1.5  X  10  )  for  system  (4m  ,$1.5  X  10°)  over  the  exchange  of  system 
(3m^,$1.5  X  10^)  for  systan  (2m^,$1.5  X  10^).  If  the  DM  expresses  the 
same  preference  order  responses  for  a  number  of  different  quadruples  of 
levels  X^  and  fixed  levels  of  xy,  then  it  can  be  deduced  that  X^  is  WDI 
of  Xy.  A  caveat  should  be  issued  in  order  to  insure  that  the  DM  is 
stating  preferences  concerning  exchanges  of  configurations  and  outcomes, 
and  not  stating  preference  for  the  configurations  or  outcomes  themselves. 
For  instance  a  rational  DM  who  prefers  an  exchange  of  the  pair  ($100,  1 
ounce  of  gold)  for  ($105,  1  ounce  of  gold)  to  an  exchange  of  the  attribute 
pair  ($40,  1  ounce  of  gold)  for  ($50,  1  ounce  of  gold)  is  obviously  not 
concentrating  on  the  exchange  itself  (if  it  is  assumed  that  the  DM  has  a 
linearly  increasing  monetary  value  preference  curve)  because  this  DM  is 
irrationally  preferring  an  increase  in  cash  of  $5  to  an  increase  of  $10. 

A  DM  who  incorrectly  stated  this  would  be  erroneously  establishing  the 
first  condition  for  WDI  at  the  single  attribute  level.  This  exchange 
preference  idea  agrees  with  Kahneman  and  Tversky  (1977)  in  their  Prospect 
Theory  which  accounts  for  the  reference  effect  of  the  asset  position  of 
the  DM  in  rational  choices. 

The  verification  of  the  appropriateness  of  the  multiplicative  form  of 
value  function  require  checking  all  subsets  of  attributes  of  WDI.  We 
present  the'  following  to  make  this  task  simpler  and  less  time-consuming. 

Theoran  1.  Given  attributes  ,  ,Xn,  the  following  are  equivalent: 

a)  Attributes  X^^, ,  ,X^  are  mutually  weak  difference  independent 
(MWDI) . 

b)  X^  is  weak  difference  independent  of  XT,  and  (X^,X^) ,  j  i-  i, 
is  preferentially  independent  (PI);  j  =  l,2,3,,,n;  n  >_  3. 

The  result  of  this  theorem  allows  a  much  reduced  effort  in  order  to 
verify  sufficient  conditions  for  the  validity  of  a  product  form  of 
measurable  value  function.  The  proof  of  this  theorem  requires  a 
fundamental  relationship  between  PI  and  WDI.  This  relationship  follows 
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the  same  reasoning  presented  in  Keeney  (1974)  and  Keeney  and  Raiffa  (1976) 
for  weak  sufficiency  associated  with  mutual  utility  independence. 

Our  proof  is  simplified  by  consideration  first  of  the  three  attribute 
cases  described  by  Laima  1: 

Lamia  1.  Given  a  set  of  attributes  A,  B,  and  C;  if  A  is  weak 
difference  independent  (WDI)  of  A,  and  if  (A,B)  is  preferentially 
independent  (PI)  of  (A,  B) ,  then  (A,B)  is  WDI  of  (X,E) . 

The  proof  of  this  laima  proceeds  as  follows.  We  let  A  =  B0C  where  0 
signifies  a  Cartesian  product  space.  The  case  inhere  (A,B)  is  WDI  of 
(A,B)for  all  pairs  of  attributes  is  a  sufficient  condition  for  the  proof 
of  Theorem  1  in  the  three  attribute  cases,  and  this  can  be  extended  to 
the  n  attribute  case,  for  mutual  weak  difference  independence  (MWDI) 

(Dyer  and  Sarin,  1979) .  The  condition  where  A  is  WDI  of  A  can  be 
represented  by 

v(a,b,c)  =  g(a°,b,c)+ h(a°,b,c)  v(a,b°,c°) ,  h>0  (A-5) 

inhere  a,  b,  and  c  represents  levels  of  attributes  A,  B,  and  C  respec¬ 
tively.  We  assume  that  the  function  g( • )  is  also  a  measurable  value 
function  with  the  same  mapping  as  v(>) .  Therefore  for  simplicity,  we 
replace  g(a,b,c)  by  v(a,b,c) .  The  function  h(.)  is  defined  as  a  positive 
value  function  similar  to  v(*) .  Since  (A,B)  is  PI  of  C,  we  know  that 

2  2  2  1  1  2 
v(a  ,b  ,c  ) >_  v(a  ,bx,c  ) 

implies 

vta^b^c1) >_  vCa^b^c1) ,  VceC.  (A-6) 

Proof  of  this  lesrma  above  requires  one  to  ascertain  that  (a,b)  is  wdi  of  c. 

Constructs  motivating  our  proof  can  be  illustrated  graphically  as  in 

Figure  A-l .  Here  a  and  b  are  scalar  attributes.  It  is  first  shown  that 

the  condition  of  (A,B)  being  WDI  of  C  holds  for  all  c  and  (a,b)  pairs 

in  E^.  Then  because  a  horizontal  line  b  =  b^  intercepts  indifference 

line  L.  and  regions  E..  and  E_,  this  allows  the  WDI  condition  to  hold  for 

all  pairs  (a,b  ) .  Now  other  (a,b)  pairs  in  E~  are  indifferent  to  the 
1  ^ 
pair  (a,b  ) .  This  extends  the  WDI  concept  to  region  E^.  This  same 

procedure  is  repeated  over  and  over  again  until  all  of  the  attribute 

space  is  covered.  Then  it  is  shewn  that  all  pairs  (a,b)  £  (A,B)  are  WDI 
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B  attribute 


L.  =  isopreference  curve  i 
=  trade-off  area  i 


Figure  A-l.  Conceptual  Illustration  of  Requirements 

for  Difference  Independence 
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c  eC  and  use  of  the  multiplicative  form  of  value  function  given  by 
Eq.  (A-2)  or  (A-3)  is  justified. 

Formal  proof  of  Lemma  1  is  now  a  relatively  simple  matter.  A  pair 
(a,b)  in  is  defined  by 

E1  =  {  (a,b,c°):  v(a,b,c°)  <_  v(a  ,b°,c0)}  ,  (A-7) 

we  assume  there  exists  an  such  that 

v(a,b,c°)  =  v(a1,b°,c°)  VtefbJsE.^  (A-8) 

Now  from  Eqs.  (A-6)  and  (A-7),  it  follows  that 

v(a,b,c)  =  v(a1,b°,c),  Vcc  C,  (a,b)  e  E^  (A-9) 

Substituting  Eq.  (A-9)  into  Eq.  (A-5)  results  in 

v(a,b,c)  =  v(a^,b^,c)  +  h(a^,b^,c)v(a\b^,c^)  VceC,  (a,b)  e  (A-10) 

We  now  combine  Eqs.  (A-8)  and  (A-10)  to  eliminate  v(a1,b°,c°)  and  this 
yields  the  desired  result 

v(a,b,c)  =  v(a°,b^,c)  +  h(a°,b°,c)  v(a,b,c°) ,  VceC,  (a,b)  z  E^  (A-ll) 

As  Eq.  (A-ll)  shows,  the  WDI  condition  is  shown  for  (A,B)  worth 
independent  of  C  in  the  region  E^.  To  extend  this  for  all  possil-.a 

(a,b)  pairs  in  space  A9B,  we  shall  next  move  into  space  E_.  There,  we 

1  z 
choose  b  such  that 

v(a^,b^,c^)<v(a^,b^,c°) <  v(a  ,b^,c®)  (A-12) 

Since  (a^,b^) e  E^,  we  may  replace  a  by  a®  and  b  by  b^  in  Eq.  (A-ll)  to 
obtain 

v(a®,b1,c)  =  v(a°,b°,c)  +  h(a0,b°,c)v(a°,b1,c0) ,  VceC  (A-13) 

We  rewrite  Eq.  (A-5)  using  the  levels  b1  and  c°  levels  as 

vfajb^jC0)  =  v(a°,b1,c®)+  h(a^,b1,c°) v(a,b°,c^)  Vac  A.  (A-14) 

New  we  set  b  =  b^-  in  Eq.  (A-ll)  bo  obtain 
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v(a,b1,c)  ®  v(a°,b°,c)  +  h(a°,b°,c)  v<a,b1,c°),  V(a,b1)cE1  (A-15) 

This  result  can  now  be  ceirbined  with  Bq.  (A-14)  to  yield 

v(a,bi,c)=v(a0/b°,c)+h(a0,b°,c)  [v (a0/b1/c°)+h(a°,b1,c0) v(a,b°,c0)} 

=v(a0>b1,c)+h(a0fb0,c)h(a0,b1,c0)v(afb°,c0),  VceC,  (a,b1)eE1(A-16) 

We  now  use  the  inequality  of  Eq.  (A-12)  to  define  and  restrict  b\ 

There  exists  an  a  with  v(a,b^,c^  >v(a°,b^,c^)  which  satisfies  Bq.  (A-16) . 
We  compare  Eq.  (A-16)  to  Eq.  (A-5)  with  b  =  b^"  and  this  shows  that 

h(a°,b1,c)  =  h(a0,b°,c)h(a°<b1,c0),  VCeC.  (A-17) 

Substituting  Eqs.  (A-13)  and  (A-17)  into  Eq.  (A-5)  with  b  =  b^  results  in 

v(a,b1,c)=v(a°,b1,c)+h(a°,b1',c)v(a,b0,c0)  =  v(a°,b°,c) 

=v(a0,b°,c)+h(a0,b°,c)  [v(a0,b1,c0)+h(a0,b1,c0)v(a,b°,c0)]  (A-18) 


now  we  canbine  Eqs.  (A-18)  and  (A-14)  to  obtain 

v^b^c)  =  v(a°,b°,c)  +  h(a°,b0,c)v(a,b1,c°) ,  (A-19) 

Region  is  defined  by 

E2  =  ( (a,b,c°)  :v(a  ,b°,c°)<v(a, b,c°)<_  v(a  ,^,0°)}  (A-20) 

2 

For  any  (a,b)cE2#  there  exists  an  a  such  that 

v(a,b,c°)  =  v(a2,b\c°) ,  Vc  e  C,  (a,b)eE2  (A-21) 

Consequently  from  Eq.  (A-6) ,  it  follows  that 

v(a,b,c)  =v(a2,b1,c),  (a,b)  eEj.  (A-22) 

Now  we  evaluate  the  right  hand  side  of  Eq.  (A-22)  using  Eq.  (A-19)  to 
obtain 

v(a,b,c)  =  v(a°,b^,c)  +  h(a°,b°,c)  v(a2,b\c^)  VccC  (A-23) 
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when  combined  with  Eq.  (A-21)  the  foregoing  yields 


v(a,b,c)  =  v(a^,b^,c)  +  h(a^,b^,c)  v(a,b,c^) ,  (a,b)eE2  (A-24) 

This  shows  the  desired  result  that  (A,B)  is  WDI  for  regions  E^  and  E2- 
This  same  process  can  be  and  is  repeated  until  the  entire  attribute 
space  is  covered.  Additional  isopreference  lines  may  need  to  be  inserted 
to  allow  overlap  of  the  indifference  regions  for  given  attribute  levels 

1  3' 

of  the  attribute  space.  This  is  shown  by  interaction  of  L.,  b  .  and 

4'  4 

b  in  Figure  A-l.  The  continuity  assumption  on  the  measurable  value 

function  v,  and  the  non-satiation  assumption  that  more  is  better  than 

less  of  a  desired  attribute;  or  that  less  is  better  than  more  of  an 

undesired  attribute,  and  the  assumption  that  h(a,b,c)  is  positive  allows 

one  to  show  that  (A,B)  is  WDI  of  C. 

The  preceding  weakened  conditions  for  establishment  of  MWDI  (and 

resulting  verification  of  the  multiplicative  form  of  value  function) 

ameliorate  drawbacks  associated  with  verifying  the  additive  form  of 

value  function.  Figure  A-2  illustrates  an  assessment  procedure  to 

establish  MWDI  of  the  attributes.  This  lessens  the  time  catmitment 

required  of  the  DM  and  analyst.  Also  it  provides  a  less  compensatory 

scoring  form,  because  of  the  product  terms  that  allows  for  more 

sensitivity  to  the  attributes.  This  is  essential  in  certain  applications. 


4.  Numerical  Example 

In  the  application  of  the  approach  suggested  here  to  an  electronic 
warfare  equipment  selection  situation,  a  proposed  measurable  value 
function,  which  can  serve  as  a  criterion  for  a  multiobjective  optimiza¬ 
tion  approach,  can  take  the  form: 

v(x)  =  f (X1,X2,,,Xn)  (A-25) 

where  the  system  effectiveness  attribute  vector  takes  the  product  form: 


f  (X1}  “  vl(3V  “  klXla  +  k2Xlb  +  k12XlaXIb 


(A-26) 


where  X^a  =  no.  of  threats  covered  by  alternatives  and  X^  =  degree  of 


Plgura  K-2.  MWUI  Aaaiiutnt  Procedure 


effectiveness  produced  by  alternatives.  Assuming  that  MTOI  has  been 
established  for  the  two  attributes,  the  product  form  above  reflects  the 
required  sensitivity  to  alternatives  with  either  an  excess  or  lack  of 
either  attribute.  Past  use  of  additive  value  criteria  in  the  electronic 
warfare  area  have  not  been  sufficiently  able  to  penalize  inferior 
alternatives.  This  has  led  to  unjustified  confidence  in  the  capability 
of  operating  systsns  as  has  been  pointed  out  by  Peterson,  Hays  and 
O'Conner  (1975) . 

To  illustrate  this  we  consider  two  alternatives  A  and  B  with  the 
following  pertinent  characteristics: 

Alternative  A:  *8  out  of  10  critical  threats  are  affected  by  the  systan 

8 

(score  10  =  .8) 

*3  out  of  the  10  of  the  critical  threats  are  covered 

_3 

sufficiently  to  assume  than  countered  (score  10  =  .3) 

Alternative  B:  *6  out  of  10  critical  threats  are  affected  by  the  systan 

_6 

(score  10  =  .6) 

*5  out  of  10  critical  threats  are  sufficientlv  countered 
_5 

(score  10  =  .5) 

Let  an  additive  value  function,  assuming  MPI  is  also  established, 
of  the  form 


V11!X1>  *  kllXla  +  k22Xlb 


(*-27) 


be  used  as  a  comparison  with  the  multiplicative  form  of  (A-26) .  Assume 

the  scaling  constants  have  been  assessed  to  be  k^  =  =  •  5  and 

k^  =  k.2  =  k^2  =  -333  so  that  v^  and  v^  are  normalized  to  equal  1.0  when 

both  X.  and  X.,  are  at  their  maximum  value  of  1.0  and  v,  =  v..  =  0.0 
la  lb  i  li 

when  both  X^a  and  X^  are  at  their  minimum  value  of  0.0.  Now  inserting 
the  values  above  (for  alternative  A;  =  .8,  =  .3  and  for 

alternative  3;  X^a  =  .6,  X^  *  .5),  the  following  results  are  obtained: 

^  =  .55  and  v^  = 


Alternative  A:  v. 


.45 


Alternative  B:  =  .55  and  =  .47 

The  results  show  that  the  additive  form  of  v^  evaluate  both  alternatives 
identically  whereas  the  multiplicative  form  of  differentiates  in 
favor  of  alternative  B.  As  a  matter  of  interest,  all  of  the  EM's  polled, 
preferred  alternative  B  which  indicates  that  there  is  a  strong  basis  for 
pursuing  the  multiplicative  criteria  form  in  certain  application  efforts 
where  sensitivity  is  paramount. 


Alternative  sufficient  conditions  which  can  be  used  to  verify  MWDI 
of  attributes  for  the  valid  use  of  the  multiplicative  form  of  value 
function  have  been  obtained.  These  conditions  allcw  for  reduced  efforts 
in  this  verification  process  which  is  of  value  to  decision  makers  and 
analysts.  A  surrmary  of  a  reccrrmended  assessment  procedure  has  been 
presented.  The  increased  sensitivity'  of  the  product  form  of  value 
function  make  this  form  particularly  useful  in  certain  applications  as  is 
evidenced  by  the  numerical  example. 
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APPENDIX  3 


EQUIVALENCE  OF  MULTIPLE  CRITERIA  DECISION  MAKING  APPRCACMS: 


1 .  introduction 

The  current  interest  in  Multiple  Criteria  Decision  Theory  (MCDT) 
has  been  prompted  by  the  desire  of  analysts  and  decision  makers  .DM)  to 
produce  solutions  which  better  reflect  the  DM's  preferences  in  decision 
situations.  The  two  MCDT  approaches  of  multiple  objective  optimization 
theory  (MOOT)  and  multiple  attribute  utility  theory  (MALT)  have  enjoyed 
increased  popularity  because  of  the  usefulness  of  these  tools  in  the 
resolution  of  complex  decision  situations  >;  Cochrane  and  Zeler.y,  1373; 
Starr,  1977;  and  MacCrimncn,  1973/. 

The  MOOT  approach  was  developed  to  be  a  computationally  efficient 
optimization  tool.  A  vector  of  objective  functions  is  optimized  with 
respect  to  each  component  to  form  a  set  of  ncn-dominated  solutions.  A 
value  function  is  formed,  based  on  the  DM's  preferences,  by  which  the 
optimum  is  formed  Xohon  and  Marks,  1975).  This  last  action  of  optimum 
selection  by  the  Did  has  not  received  a  proportional  amount  of  attention 
as  has  the  optimization  techniques. 

The  MAUT  approach  was  developed  to  be  a  decision  making  aid.  A 
scalar  function  is  used  to  combine  the  DM's  utility  for  the  attributes. 
This  scalar  function,  which  is  often  called  a  social  choice  function 
)SCF)  is  formed  based  on  a  set  of  preferences  of  the  DM.  The  alternative 
policies  are  ranked  with  respect  to  maximizing  the  DM's  utility  for  the 
outcomes  of  these  policies  through  the  use  of  this  SCF. 

A  question  of  importance  to  the  structural  research  in  MOOT  and 
MAUT  concerns  the  analytic  equivalence  of  an  optimal  policy  produced  by 
both  approaches  to  a  common  decision  situation.  That  is,  under  certain 
weak  assumptions,  the  optimal  ;most  preferred'  alternative  is  r.on-dcni- 
r.ated.  Theorem  1,  to  be  presented  below,  addresses  this  issue.  A 
second  question  arises  from  contemplating  the  use  of  a  specific  MOOT  or 
MAUT  technique  in  an  application.  This  item  concerns  the  fact  that  the 
second  best  alternative  policy  may  be  dominated,  and  hence  in  jeopardy 


of  not  being  considered  as  the  new  optimal  if  for  some  reason  the  origi¬ 
nal  optimal  could  not  be  implemented.  Le:nmas  3  and  A. as  well  as  an  ex¬ 
ample  to  be  presented, address  this  latter  situation. 

A  specific  decision  situation  can  be  characterized  by  a  set  of 
alternate  actions  ix  =  vx^,f,x  ))  in  an  admissible  decision  space, 

;x  e  X?  where  X  is  partially  ordered  by  £  and  X'  is  the  set  of  ail  ncn- 
dcminated  points  in  X,  and  a  vector  of  cardinal  utility  functions  u,x. 
representing  the  DM's  felicity  for  the  alternative  actions  (or  the  out¬ 
comes  which  are  a  result  cf  the  actions i .  mis  information  is  now  in¬ 
corporated  into  the  format  of  both  approaches. 


vanT 


Tiie  muitiattribute  utility  case  considers  combining  r.  individual 
utility  function  optimizations 

.  n 

max  u • i x } ,  u .  e  u ;  u :  X  -  R  ,  3 

XeX 

(where  r.  is  a  positive  integer;  into  a  social  choice  function  T, 

3U  >  U:  P“  -  R  to  come  up  with  a  scalar  ranking  form  and  solution 

max  Jiu..  (xj  , , ,  ,u  ix'  >  =  „  Vu\x);  =  - 

..  i  rl  AG  A  .'ihbl 

XeX 


:-:oot 


vector  of  value  f’ur.ctions 


v-x;  =  ivrx),,,,V;n,x.  .  ;  v  c 
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and  optimizing  with  respect  to  each  component  to  produce  a  non-dominated 
solution  set  ( MDSS }  V'C  V  3-  X'  C  X  and  x  e  X.  Then  we  shall  say  that  x 
dominates  x  if  -*•  %  x  e  X* 

v.  ix)  >  v.  ixi  for  some  v.  ;  i  =  1,,,,r.  .5—4 

1  -L 

v  .(x)  £  v  .(x)  ,rj  i  i  '.3-5 

Then  a  cost-ODtimizatior.  orccess  is  used  to  incarcerate  the  TVs  utility 


in  a  social  choice  function  for  selection  of  the  "bes^" 

max  Civ  x),  = 
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2.  Development 

The  question  of  the  equivalence  of  D^^  and  D;>!00T  will  be  answered 
in  two  parts.  First  it  is  hypothesized  that  =  D*  is  a  global  opti¬ 

mum  of  the  scalar  choice  function  U  based  on  the  DM's  utility  for  the 
salient  attributes.  Second,  it  is  shown  below,  that  under  weak  condi¬ 
tions,  the  global  optimal  policy  is  also  the  optimum  of  the  NDSS 

(this  latter  optimization  also  being  based  on  the  DM's  utility).  Con¬ 
sider  the  following  definitions: 

V  =  {  u(x) :  x  e  X  }  (B— 7 ) 

V'  is  the  set  of  all  non-dominated  points  in  V 

V(X')  =  {  u(x) :  x  e  X*  }  (3-8) 

Now  we  will  proceed  to  show  that  also  equals  D*. 

Lemma  1:  Assume  u  is  strictly  isotone,  i.e.,  x  <  x' 

-  u(x)  <  u(x’).  Then  V'  CV(X'). 

Proof:  We  wish  to  show  that  v  e  V'  implies  v  e  V(X').  Assume  v  e  V'  but 
that  v  i  V(Xr).  Since  v  e  V'  CV,  there  exists,  an  x  e  X  such  that 
v  =  u(x).  Also  x'  e  X*  *  u(x')  e  V(X')  is  equivalent  to  u(x')  i  V(X’)  ♦ 
x  i  X';  thus,  x  i  X'.  Now,  x  i  X'  implies  the  existence  of  an  x  e  X' 
such  that  x  <  x  and  hence  u(x)  <  u(x),  which  contradicts  the  initial 
assumption  that  v  e  V' .  Thus,  v  e  V'  implies  v  e  V(X’).  Q.E.D. 

Lemma  2.  Let  f:  Z  -*■  R  be  isotone  on  Z  where  Z  is  partially  ordered 

(<  )  and  assume  Z'  C  Z  is  such  that  for  any  z  e  Z  there  exists  a  z  e  Z' 
z 

such  that  z<  z'  .  Then 

Sup  f(z)  =  Sup  f(z) 
z  c  Z  Z  e  Z* 


Proof:  Clearly,  Z'  C  Z  implies 

Sup  f(z)  <  Sup  f(z)  .  ( B— 10 

z  £  Z'  z  e  Z 

We  wish  to  show  the  reverse  inequality.  Let  (z^)  be  a  sequence  in  Z 
such  that  f (z^)  converges  up  to  Sup^Hz) .  For  each  k,  choose  z'k  e  Z' 
such  that  z,^  ^  z'k  and  hence  f(zk)  =  The  following  equality  - 

inequality  string  proves  the  result: 


Sup  f(z) 
Z  e  Z 


(B-11) 


=  lim  Inf  flz^J 

=  lim  Inf  f(z'  ) 
k  K 

=  Sup  f(z)  . 

z  e  Z* 


(B-12) 


(B-13) 


Q.E.D. 


Theorem  1:  Let  u  be  strictly  isotone  and  U  be  isotone  on  their  respec¬ 
tive  domains.  Then: 

Sup  U(u(x))  =  Sup  U(u(x))  .  (B-14 


x  c  X 


x  e  X' 


Proof:  Clearly,  since  X'  C.  X,  Sup  U(u(x))  S.  Sup  U(u(x)', .  We  wish  now 

v  *  Vi 


x  e  X‘  x  e  X 

to  prove  the  reverse  inequality.  By  definition, 


Sup  U(u(x))  =  Sup  U(v)  (B- 

x  c  X  v  e  V  and 

Sup  U(u(x) )  =  Sup  U(v)  (B- 

X  e  X’  V  e  V(X’) 

It  follows  from  Lemma  2  and  the  fact  that  for  any  v  e  V  there  exists  a 
v’  e  v'  such  that  vi  v'  that  implies 

Sup  U(v)  =  Sup  U(v)  (B- 


B-15 ) 


(B-1 6) 


v  e  V 


v  €  V' 


Lemma  1  implies: 

Sup  U(v)  <  Sup  U(v). 
v  e  V’  v  E  V(XM 

The  above  inequality  and  equalities  then  imply  that 

Sup  U(u(x)) 

X  £  X 

=  Sup  U(v) 

V  c  V 

=  Sup  U(v) 

V  e  V’ 

<  Sup  U(v) 
v  c  V(X’) 


(B-U) 


(B-13) 
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(B-20) 


(B-21) 


B-A 


=  dmoot 

(B-22) 

=  Sup  U(u(x) ) 

(B-23) 

X  e  X' 

=  D* 

(B-24) 

which  proves  the  theorem. 

Q.E.D. 

Therefore,  the  intended  result  is  proven.  It  can  be  seen  that  the 
optimal  policy  is  non-dominated. 

When  a  ranking  of  alternatives  is  required  as  a  solution  to  a  de¬ 
cision  situation,  one  is  tempted  to  only  consider  the  NDSS  for  the  top 
rankings.  Figure  B-1  shows  the  two  dimensional  discrete  case  with  three 
non-dominated  solutions  (a,  b,  and  c)  and  one  dominated  solution  d  (b 
dominates  d).  The  isopreference  lines  are  formed  through  elicitation 
of  the  preference  structure  of  the  DM.  As  can  be  seen  by  comparison  of 
the  intersection  of  the  alternatives  and  the  isopreference  lines,  the 
dominated  solution  should  actually  be  ranked  ahead  of  many  of  non-domi¬ 
nated  solutions.  To  investigate  this  condition,  consider  the  following 
Lemmas  and  example. 

Lemma  3.  Let  x*  be  the  optimal  alternative  such  that  no  other  x  in  X 
dominates  x*.  Let  x2  be  the  second  best  optimal  alternative,  where 
x^eX.  Assume  that  an  alternative  policy  x^cX  exists.  If  x2  is  domi¬ 
nated  (x2*X’)  by  x^c X,  then  x^  must  equal  x#  (i.e.,  x2  can  be  dominated 
only  by  x* ) . 

Proof:  From  theorem  1,  an  optimal  policy  x#,  must  be  non-dominated. 
Hence  x*eX',  v(x#)cV',  and  from  Lemma  1,  v(x#)eV(X').  For  x2  to  be 
dominated ,  x^e  X 

v^x^)  >  v^(x2)  for  seme  v^;  i  =  1,,,,n  (3-25) 

Vj(x3)  >  Vj(x2)¥j  t  i  (B-26, 

If  x^  i  x*,  then  x#cx'  by  definition  of  the  optimal  policy.  Since  x2 
is  the  second  best  optimal,  then  the  one  alternative  which  dominates  x2 
must  be  non-dominated.  One  is  now  faced  with  the  following  situation. 
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Dominated  And  Non-Dominated  Alternatives 


Either  x2  is  not  dominated  (XgsX'),  or  =  x*,  or  i  x#  which  requires 
x-jtfX.  If  x^X,  this  violates  the  original  assumption.  Thus,  if  the 
second  best  policy  is  dominated,  it  must  be  dominated  by  the  optimal 
policy.  Q.E.D. 

Lemma  4.  Let  the  second  best  alternative,  x2  be  dominated  by  the  optimal 
policy  x*.  Let  x^X*.  If  x*  is  eliminated,  then  x2  now  becomes  no n- 
dominated  (x^X' ) . 

Proof:  If  x2<X ’ ,  then  there  exists  one  x  (called  x*) 

v^x#)  >  v(x2)  for  some  vi ;  i  =  1,,,,n  (3-27) 

v^(x»)  >  v(x2),  V  j  i  i  (B-2B) 

From  Theorem  1  and  Lemma  3,  the  optimal  alternative  is  non-dominated . 
Therefore,  eliminating  x*  creates  the  condition  of  no  xeX  which  satis¬ 
fies  the  two  conditions  above  with  respect  to  x2,  and  so  by  definition, 
x2  is  now  non-dominated .  Q.E.D. 

Theorem  1  shows  the  expected  result  that  the  optimal  alternative  is  a 
member  of  the  NDSS,  but  Lemmas  3  and  4  show  that  it  is  possible  for  the 
second  best  alternative  to  not  be  a  member  of  the  NDSS.  As  shown  on 
Figure  B-1,  the  preferences  of  the  DM  would  rank  all  alternatives  as 
b  }  d  )  c  )  a.  If  only  the  non-dominated  solutions  were  considered, 
the  ranking  of  the  alternatives  becomes  b  V  c  }  a.  Transitivity  would 
then  call  for  us  to  compare  the  first  (b)  and  third  (c)  or  fourth  (a) 
alternatives  which  is  illogical  since  the  obvious  comparison  which 
would  make  sense  to  the  Did  is  between  the  first  (b)  and  second  (d) 
alternative.  It  is  not  difficult  to  imagine  comparing  the  first  and 
nth  alternatives  (when  considering  only  the  NDSS)  for  a  system  with  a 
large  number  of  alternatives.  To  prevent  this  condition,  care  must  be 
taken  to  prevent  eliminating  an  alternative  which  is  not  dominated  by  a 
majority  of  the  alternatives.  To  be  absolutely  certain  that  a  dominated 
alternative  has  not  been  inappropriately  eliminated,  the  NDSS  should 
be  reformed  without  the  optimal  policy  to  see  in  any  alternatives  now 
enter  NDSS  before  the  new  optimal  is  identified.  Consider  the  follow¬ 
ing  example. 

Assume  a  company  is  interested  in  acquiring  property.  There  are 
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several  parcels  of  land  available.  The  DM  for  the  company  has  indicated 
that  the  attributes  of  importance  concerning  the  property  are  size  and 
quality.  The  Table  below  shows  the  alternatives  (purchase  area  i)  and 
associated  attribute  scores  as  supplied  by  the  DM. 


area 

amount 
score  (S^) 

quality 
score  (Sg) 

A 

.3 

.8 

B 

.7 

.5 

C 

.5 

.7 

D 

.2 

.2 

E 

.9 

.3 

It  can  be  seen  that  A  dominates  all  alternatives  except  E,and  P  is  dom¬ 
inated  by  all  alternatives.  It  is  patently  clear  that  D  should  be 
eliminated,  but  what  about  B  and  C?  By  definition,  alternatives  A  and 
E  are  the  only  members  of  the  NDSS.  Depending  on  the  preference  structure 
of  the  DM,  either  A  or  E  would  be  selected  as  the  optimal  choice  and  the 
other  would  be  assumed  "second  best."  This  last  assumption  may  be 
erroneous  as  shown  by  the  following  calculations.  For  efficiency,  we 
will  choose  a  linear  additive  value  function  for  the  DM 

V1  =  kS*  +  (1  -  k)s|  (B-2  9) 

where  is  the  jth  attribute  score  for  alternative  i.  Assuming  values 
for  the  scaling  constant  k,  the  following  results  are  obtained: 


Considering  solutions 

A,  B,  C,  and  E 

Considering  solutions 

A  and  E  only 

Scaling  constant 
values 

A  }  C  >  B  >  E 

A  }  E 

0  <  k  <  .5 

A  }  B,  C,  E 

A  >  E 

k  =  .5 

A  >  E  >  B  >  C 

A  }  E 

.5  <  k  <  .83 

A,  E  >  B  >  C 

A  — E 

k  =  .83 

E  >  A  }  B  >  C 

■E  >  A 

.83  <  k  <  1 

For  the  cast  0  <  k  <  .5,  the  non-dominated  alternative  E  is  not  as  good 
as  either  B  or  C,  yet  if  B  or  C  would  have  been  eliminated  for  the  single 
1  domination  by  A,  for  this  set  of  scaling  constant  values,  the  first  and 

i 


I 

E 

i 


fourth  ranked  choices  would  have  been  compared.  If  for  some  reason 
alternative  A  would  not  have  been  implemen table,  then  the  CM  would  have 
been  faced  with  selecteing  the  fourth  alternative  if  the  NDSS  would  not 
have  been  reformed.  This  example  shows  that  one  must  be  very  careful 
when  eliminating  alternatives  which  are  not  dominated  by  a  majority  or 
all  of  the  other  alternates. 

3.  Consistency 

The  basis  for  part  of  the  formulation  in  the  general  situation 
statement  is  the  assumption  that  the  DM  is  rational  and  consistent,  and 
the  optimum  policy  is  a  member  of  the  possible  set  of  decisions  in  the 
MAUT  formulation.  That  is  we  assume  that  the  DM's  utility  over  the 
total  attribute  space  U(u^ (x) , , , ,u  (x) )  is  consistent  with  his  or  her 
utility  over  a  reduced  attribute  space  (defined  by  the  NDSS)  U(v.(x),,,, 
v  (x)).  This  assumption  seems  reasonable,  and  deviation  from  this  con- 
sistency  may  cause  variation  in  policy.  It  is  noted  that  a  slight  varia¬ 
tion  in  DM  consistency  will  produce  strategically  equivalent  policies 
from  MOOT  and  MAUT  which  is  the  expected  result  of  any  techniques  used 
to  resolve  a  common  decision  situation  (Keeney  and  Kirkwood,  1977). 

4.  Summary 

The  purpose  of  this  appendix  was  to  demonstrate  the  intuitively 
obvious  result  that  MOOT  and  MAUT  will  identify  strategically  equivalent 
policy  as  optimal  when  both  approaches  are  applied  to  a  common  decision 
situation,  and  to  show  that  caution  must  be  exercised  in  eliminating 
dominated  alternatives  from  consideration  in  a  selection  process.  It  was 
assumed  that  a  consistent  DM  is  utilized  in  the  application.  A  warning 
is  issued  that  the  above  result  may  not  hold  if  the  elements  of  uncer¬ 
tainty,  posterior  equity  considerations,  and  a  group  of  DMs  are  present 
in  the  decision  situation  (Bodily,  1976). 

Areas  for  continued  research  are  identified  by  the  need  to  further 
explore  the  problem  of  inconsistency  of  utility  of  DMs,  (Tversky  and 
Kahnman,  1977),  and  to  formulate  quantitative  techniques  to  justify 
elimination  of  alternatives  by  domination  in  the  case  where  an  alter¬ 
native  is  dominated  by  more  than  one  other  alternative.  (Appreciation  is 
expressed  to  C.C.  White  and  A.P.  Sage  for  contributions  to  this  effort.) 
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ORGANIZATIONS  CONTRIBUTING  TO  THE  EWARD  EFFORT 


Air  Force  Systems  Command 
Aeronautical  Systems  Division 
Wright-Patterson  AFB,  Ohio  45433 

Defense  Systems  Management  College 
Policy,  Analysis  and  Process  Division 
Fort  Belvoir,  Virginia  22060 

Headquarters  Air  Force  Systems  Command 
Electronic  Warfare  Acquisition  Branch 
Andrews  AFB,  Maryland  20331 

Headquarters  Department  of  the  Air  Force 

Office  of  Deputy  Chief  of  Staff  for  Research  and  Development 

Washington,  D.  C.  20330 

Headquarters  U.S.  Marine  Corps 
Code  -  AWN 

Washington,  D.  C.  20380 

Headquarters  Strategic  Air  Command 
Operations  and  Plans 
Omaha,  Nebraska  68113 

Hughes  Aircraft  Corporation 

Defense  Systems 

Canoga  Park,  California  91304 

Naval-Air  Systems  Command 
PMA/PME 

Washington,  D.C.  20361 

Naval  Avionics  Center 

21st  Street  and  Arlington  Avenue 

Indianapolis,  Indiana  46218 

Naval  Surface  Weapons  Center 
Electromagnetic  Systems  Division 
Dahlgren,  Virginia  22448 

Office  of  the  Secretary  of  Defense 
Defensive  Systems  Division 
Washington,  D.C.  20301 

Raytheon  Company 
Electromagnetic  Systems  Division 
Lexington,  Massachusetts  02173 

Several  people  who  contributed  to  this  effort  requested  that  they  not 
be  identified  personally  because  of  the  nature  of  this  application.  Con¬ 
sequently  no  names  of  individuals  have  been  used  here. 
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ELICITATION  OF  PREFERENCE  STRUCTURES 

Within  the  EWARD  effort,  elicitations  were  carried  out  with  the 
decision  makers  (DM)  and  advisors  in  order  to  explore  the  relation¬ 
ships  among  the  attributes  with  respect  to  preferential  independence, 
utility  independence,  utility  assessment  and  scaling  constant  magnitudes. 
The  attributes  and  their  ranges  are  listed  in  Table  4  of  Chapter  5. 

The  described  elicitation  process  took  place  with  a  member  of  stake¬ 
holder  Group  1,  but  similar  processes  also  occurred  with  the  members 
of  Groups  2  and  3. 

1.  Preferential  Independence:  The  following  is  an  abbreviated  set 
of  questions  and  answers  which  were  used  in  ore  case  to  establish 
preferential  independence  between  aerodynamic  performance  (X^ )  and  life 
cycle  cost  (X2). 

Analyst  (A):  Consider  the  attributes  X^  and  X2  as  shown  on  Figure  D-la. 
Assume  all  the  other  attributes  are  at  their  ’worst  levels  (Table  4, 
Chapter  5).  Suppose  you  are  at  point  A.  Would  you  now  prefer  to  move 
to  point  B  or  C? 

Decision  Maker  (DM):  Point  B. 

(A)  What  point  along  the  x1  =  .75  line  would  be  equally  preferred  to 
point  B? 

(DM)  Point  C' 

(A)  Now  what  point  along  the  x1  axis  (x2  at  its  best  level)  would  be 
equally  preferred  to  points  B  and  C'  (likewise  find  the  equally  pre¬ 
ferred  point  along  the  x2  axis)? 

(DM)  Point  D  (Point  E) 

This  now  forms  a  rough  isopreference  line  as  shown  in  Figure  D-lb. 

This  process  is  repeated  starting  at  points  A*  and  A"  to  form  isopre¬ 
ference  lines  L2  and  L^.  Then  the  levels  of  all  the  other  attributes 
except  X.j  and  X2  (X^)  are  changed  first  to  intermediate  levels,  and 
then  their  highest  levels,  and  the  process  repeated  to  form  isoprefer¬ 
ence  lines.  If  the  isopreference  lines  on  Figure  1-Db  are  the  same 
regardless  of  the  levels  of  X-^) ,  then  the  attributes  X1  and  X2  are 
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preferentially  independent  (PI)  of  the  other  attributes  (X^,  X2  PIX-^- 
where  X-j^  =  X^X^  in  this  case).  In  this  manner,  mutual  PI  (MPI)  was 
established  by  investigating  PI  for  the  various  combinations  of  attri¬ 
butes  for  all  higher  level  attributes  X^ ,  X2,  X3,  X^  and  within  the 
groups  of  lower  level  attributes  (X1a,  X1b,  X1c;  and  X^,  X3b,  and  X3c). 
2.  Utility  Independence  and  Utility  Assessment:  The  condition  of 
utility  independence  was  established  for  the  attribute  of  life  cycle 
cost  (X2)  and  the  utility  of  this  attribute  was  assessed  through  a  set 
of  questions  and  a  process  which  are  summarized  below. 

(A)  Consider  the  lottery  shown  on  Figure  D-lc.  Set  all  the  other 
attributes  at  their  worst  level  except  X2,  now  would  you  prefer  a 
lottery  with  a  50-50  chance  of  getting  a  system  with  minimum  cost  of 

Q  Q 

$1x10  (assume  the  utility  of  this  amount  equals  1.r>u  ($1x10  )  =  1.) 

q  q 

or  system  with  maximum  cost  of  $2  x  ICr  (assume  u  ($2x1(r)  =0),  or  for 

q 

certain  a  system  with  cost  of  $  lx  ICr? 

(DM)  The  certain  return. 

(A)  What  if  the  certain  outcome  was  a  system  with  a  cost  of 

q 

$1.3x10  ,  which  would  you  prefer? 

(DM)  Still  the  certain  outcome. 

This  continued  until  the  certainty  equivalence  for  the  lottery 

q  8  Q 

u($1.5x10  )  =  ,5u($1x10  )  +  .5u($2x107)  =  .5  was  established  at  a  certain 

q 

system  with  a  cost  of  $1.5x10  .  This  lottery  process  was  repeated  for 
different  levels  of  the  other  attributes.  The  same  choices  resulted 
independent  of  the  levels  of  the  other  lotteries,  thereby  establishing 
utility  independences  (UI)  of  X2.  Now  that  X2  was  established  as  UI, 
the  utility  of  this  attribute  could  be  assessed  independently  of  the 
other  attributes.  Now  other  lotteries  were  formed  to  define  other 
certain  equivalences  and  thereby  define  a  utility  curve.  After  iteration 
and  corroboration  by  the  group  members,  the  utility  curve  for  X2  for 
stakeholder  group  1  is  shown  on  Figure  D-ld. 

From  Theory  6.2  (Keeney  and  Raiffa,  1976),  the  conditions  of  MPI  of 
the  attributes  and  an  attribute  X^  being  established  as  UI,  establishes 
MUI  for  the  groups  of  higher  level  attributes)^ ,  X2,  X^,  X^  and  lower 
level  attributes  X1a,  X^,  Xlc  and  X2a  ’  X3b’  X3c’  This  condition  of  MUI 
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was  corroborated  by  investigation  of  UI  of  the  various  attributes  in 
the  manner  described  above.  MUI  allows  the  utility  for  each  of  the 
attributes  to  be  assessed  independently  with  a  process  as  discussed 
previously  for  X£. 

3.  Scaling  constant  evaluation:  The  weights  for  the  various  attri¬ 
butes  were  established  through  the  abbreviated  elicitation  process  now 
described.  The  multiplicative  form  of  an  aggregated  utility  function 
was  established  as  a  scalar  choice  function  (as  discussed  in  Section 
4  of  Chapter  5).  For  the  aerodynamic  performance  attributes,  this  form  is 


1  +  k^  =  (1  +  ^k1au1a(x1a))(1  +  k7k1bu1b(x1b))(l  +  k^u^lx^)  (D-1) 

where  k^  is  the  aggregated  scaling  constant,  u^  is  the  aggregate  utility 
function  for  aerodynamic  performance,  and  is  the  individual  attri¬ 
bute  scaling  constant  ,  and  u^  is  the  utility  function  for  the  attri¬ 
bute  levels  of  x;i  (i  =  a,b,c). 

First  we  established  the  ordering  of  k.^,  k^b,  and  k^c  with  respect 
to  magnitude. 

(A)  Assume  all  lower  level  aerodynamic  attributes  are  at  their  lowest 
level.  Would  you  prefer  to  obtain  a  system  which  moves  the  system 

3 

weight  from  4500  kg  down  to  500  kg,  or  a  system  with  volume  of  1.5m 

3 

instead  of  4.1m  ,  or  a  system  that  demands  only  45  KVA  instead  of 
105  KVA? 

(DM)  I  would  opt  for  the  system  with  the  low  volume  (this  indicates 
that  k1b  >k1a,  k1c). 

(A)  Now  which  choice  would  you  prefer  between  weight  and  power  systems? 
(DM)  I  would  next  choose  the  system  with  low  weight  (this  indicates 

kta>klc>' 

Therefore  the  order  of  magnitude  for  the  scaling  constants  is  k1b  > 
k1a  >k1c’ 

(A)  Now  to  establish  numbers  for  these  instants,  assume  you  have  two 
systems  with  the  following  characteristics:  one  system  has  the  volume 
and  power  attributes  at  their  worst  level  and  the  weight  attribute  at 
its  best  level  (x^#,  x^g,  x^)  and  the  other  system  with  the  weight  and 
power  attributes  at  their  worst  level  and  the  volume  attribute  at  an 
unspecified  level  (x^,  x1b,  x^).  What  should  x^  equal  for  the  two 
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systems  to  be  equally  preferred? 

(DM)  xlb  =  2.4m3 

Substituting  these  values  into  eq.  (D-1)  yields 

k2u2(2.4)  =  k1  (D-2) 

where  u2  can  be  obtained  from  the  utility  curve  for  cost.  The  question 
was  repeated  for  the  power  attribute: 

(A)  What  level  of  would  make  systems  with  characteristics  of 

x1a’  xib’  xic  equally  Preferred  to  x.,°,  x^,  x^  . 

(DM)  x1b  =  3.5 

Substituting  these  values  into  eq.  (D-1)  yields 

k2u2(3.5)  =  k3  ( D— 3 ) 

(A)  Now  for  what  probability,  p*,  will  a  lottery  between  systems  with 
attributes  of  x^,  x2*,  x^*  with  probability  p*  and  x°,  x£,  x^  with 
probability  1-p#  be  equally  preferred  to  a  system  with  attributes 
x°,  x2,  x°  for  certain? 

(DM)  p*  =  .59 

Substituting  into  eq.  (D-1)  yields 

p*  =  kib 

Now  for  consistency,  u.(x.°,  x.?,  x.°)  =  0  and 

1  1a  10  10  (D-4) 

u1(xll«  xib'  xi£}  =  1 

which  when  substituted  into  eq.  (D-1)  yields 

1  +  k1  =  (1  +  k7kla)(1  +  kjl^MI  +  k^^)  (D-5) 

Now  we  have  four  variables  (k^ ,  kla,  k.^,  k1(J  and  four  equations 
(D-2,  D-3,  D-4,  D-5)  and  hence  all  the  variables  can  be  evaluated  to 
yield  kla  =  .48,  klb  =  .59,  k1c  =  .24,  k^  =  -.6. 

These  exercises  were  repeated  for  all  groups  with  the  results 
shown  on  Tables  8  and  9  of  Chapter  5. 
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